For operations on the pancreas, precise anatomical knowledge of the operating area is required. By means of overlays in data glasses (augmented reality, AR), 3D models of the individual organ can be displayed over the surgical field. However, the creation of the model is time-consuming and the placement of the model in the operating theatre is imprecise, as many steps are currently still performed manually.

In the AHrEZ project, researchers are developing new methods and processes to highlight patient-specific structures of the pancreas as automatically as possible from medical image data and to display them in 3D in AR glasses. With the glasses, the 3D structures based on patient-individual imaging data can be viewed while at the same time the normal operating environment remains visible. Another goal of AHrEZ is to project the 3D data in AR onto the patient's pancreas in real time during the operation, without increasing the workload through additional interaction of the doctor with the technology. The changing light conditions in a state-of-the-art operating theatre are also taken into account to ensure optimal visibility of relevant structures.

Due to the simplified and fast workflow, the use of augmented reality in the operating room is becoming increasingly attractive and is being accepted by surgeons as a valuable support. Especially in complex pancreatic procedures, risks can be better assessed and patient safety increased.