After years of research, augmented reality (AR) arrived in the operating theatre. With this, an eminent milestone has been reached. The first ever holographically navigated spine surgery with direct navigation was performed at Balgrist University Hospital at the beginning of December 2020. Prof. Dr. med. Mazda Farshad, Surgeon in Chief and Spine Surgeon, carried out the procedure with the help of AR glasses (HoloLens 2). With this first procedure, a randomized controlled clinical study is kicked off to verify the benefit of this surgical innovation.
Using CT imaging, 3D representations of the affected anatomy are generated and directly projected into the surgical field overlaying the real anatomy during the operation. With this, surgeons can see the patient’s 3D anatomy. The AR navigation software guides critical step of the surgery. For example, the exact insertion point and trajectory of a screw is shown directly on the patient’s anatomy. “AR enhances the surgeon’s senses and improves their perception,” said Farshad, Principal Investigator and Medical Director of Balgrist University Hospital.
Prof. Marc Pollefeys, Professor at the Institute for Visual Computing at the ETH Zurich and Head of the Microsoft Mixed Reality & AI Lab in Zurich, who leads the technology partnership on the Microsoft side, is of course very happy about the news of the successful operation: „Prof. Farshad and the Incremed team are using our HoloLens exactly as we always imagined: A technology that enables people – in this case a doctor – to operate more precisely, faster and safer. We are very proud of this great success of the team and hope to move on to the next phase of the study soon“.
The patient suffered of lower lumbar spine degeneration, a significantly narrowed spinal canal and corresponding strong pain and sensory disorders in the legs. His symptoms were gone after surgery and is doing well: “Regarding some of the pictures, I I’m fascinated that something like that is possible. Therefore, I’m very proud to be the first patient in line.”
Pioneer study with holographically navigated spine surgery
The Swissmedic-approved study focuses on the possibility of using augmented reality (AR) to support spine surgery. It is part of Zurich University Medicine’s SURGENT (Surgeon Enhancing Technologies) Flagship Project. Image data from AR glasses will soon make orthopedic surgery more efficient, precise, and safer for patients. The project is being carried out with Balgrist ROCS (Research in Orthopedic Computer Science) headed by Prof. Fürnstahl and Incremed, a university start-up supported by Balgrist Beteiligungs AG. Together with their technology partner, Microsoft, they are currently leveraging AR for developing the next-generation of surgical navigation solutions in orthopedics.
The principal investigator is Prof. Dr. med. Mazda Farshad, Head of the SURGENT Flagship Project and Medical Director of Balgrist University Hospital. The publication date for the study is not yet known.