Key Takeaways
1. The KARVIMIO project aims to enhance surgical procedures using augmented reality (AR) and artificial intelligence (AI) to provide in-situ instructions directly within the user’s line of sight.
2. A user-centered development approach involves active participation from surgical teams and equipment manufacturers, focusing on usability and minimizing distractions during high-pressure situations.
3. Potential risks include over-dependence on technology, technical malfunctions, and ethical concerns regarding accountability for incorrect instructions provided by the system.
4. The project considers ethical, legal, and social implications (ELSI), emphasizing the importance of trust, data protection, and maintaining human accountability in surgical contexts.
5. Beyond surgical operations, AI and AR technologies could improve training, documentation, and workflows in central sterilization services, highlighting their broader applications in healthcare.
In the newest issue of its Forschung aktuell series (11/2025 / in German), the Institute for Work and Technology (IAT) at Westfälische Hochschule Gelsenkirchen closely examines the KARVIMIO research initiative. Supported by the German Federal Ministry of Education and Research (BMBF), this project looks into how artificial intelligence and augmented reality can be utilized in operating rooms to assist surgical teams and boost patient safety.
Innovative In-Situ Instructions
The project aims to create “in-situ instructions” – visual, step-by-step guides shown through AR glasses or head-mounted devices like Microsoft’s HoloLens 2. These guides are visible directly within the user’s line of sight. The AI identifies the surgical tools being used and overlays the relevant setup or usage instructions onto the actual object. This removes the necessity for printed manuals, which are not practical in sterile settings. A depth camera also improves the system by allowing it to detect objects that are not in the user’s direct line of sight.
User-Centered Development Approach
Under the leadership of Elena Fitzner and Dr. Peter Enste, the project team adheres to a strictly user-focused approach. Throughout every phase, surgical assistants, equipment manufacturers, and central sterilization personnel have been actively involved via workshops and practical testing. Participants stressed the need for user-friendly controls, bright color displays, and visuals that are easy to interpret. Meanwhile, some raised concerns that AR systems could be distracting, especially in high-pressure situations or during routine tasks.
Risks and Ethical Considerations
There is also a chance that personnel might become too dependent on the technology, which could lead to a gradual decrease in their routine knowledge. Technical problems – such as wrong object identification or system malfunctions – could further complicate surgical workflows. In addition to these practical issues, the application of such systems brings forth significant ethical and legal dilemmas. For instance, who would be held accountable if the system delivers incorrect instructions? Furthermore, how can one guarantee that the technology aids rather than replaces human accountability in critical instances?
Along with the technical advancements, the project also explores ethical, legal, and social dimensions, adhering to the ELSI framework (Ethical, Legal, and Social Implications). Significant themes encompass trust in technology, data protection, professional accountability, and the development of skills. The main aim is to create systems that amplify human abilities instead of taking their place.
The researchers recognize vast opportunities for integrating AI and AR in the surgical environment. Beyond aiding during surgical operations, these technologies could significantly benefit training for surgical assistants, assisting documentation, and enhancing workflows in central sterilization services.
Source:
Link