Sterile, with style:

mediCAD Hectec brings Microsoft HoloLens 2 to the operating room!

As soon as the patient is under anesthesia, the surgeons get to work. Precision is the order of the day; the shorter the operation, the better is the outcome for the patient. In orthopedics, surgeons make sure this is the case by planning procedures digitally, in advance - especially when it comes to selecting prosthetics. This is where mediCAD comes in. But, how helpful would it be if surgeons could take a 3D version of their plans into the operating room? The answer: very helpful indeed. That’s why the company developed its solution: mediCAD® Mixed Reality (MR), which allows surgeons to use a Microsoft HoloLens 2 headset to access and interact with the necessary information without contaminating the sterile environment.

The challenge: Taking the plan into the Operating Room (OR)

Working in a hospital is stressful. For many orthopedic surgeons, the day often starts as early as 8 a.m. with the first operation. Between surgeries, they have to fit in office hours, rounds and prepare for upcoming procedures. They keep up this hectic pace all day, but they never forget that each patient and each operation is unique. Proper planning is therefore essential. “We develop all our solutions in collaboration with experts in orthopedic surgery,” says Eric Erdmann, Head of Development at mediCAD Hectec. “Our goal is to create solutions that can be integrated seamlessly into day-to-day hospital life with a view to providing the best possible support for planning and performing operations.”

The company already offers mediCAD® 3D, a tool for producing three-dimensional plans for orthopedic procedures during pre-op. This allows doctors to align implants and screws with greater precision than when using 2D planning tools. But as soon as they enter the OR, accessing the plan becomes rather tricky. “Some surgeons actually print out the plans and hang them up in the operating room. But the human body is often a good deal more complex than can be depicted on an A3 sheet of paper,” says David Würdinger, Product Manager at mediCAD Hectec. “Of course, the OR is equipped with screens displaying information relating to the operation. The problem with this setup is that it’s time-consuming: the surgeon must step away from the patient, remove their gloves, operate the computer, look at the plans without the patient in front of them, put on new sterile gloves, return to the patient, and pick up again where they left off. That’s all rather inconvenient.”

mediCAD Hectec has developed a better solution. The research project that began in 2018 is now reality and goes by the name mediCAD® Mixed Reality (MR).

The solution: Microsoft HoloLens 2 brings operation plans into the OR

The MR technology requires the right hardware, such as Microsoft HoloLens 2, to project objects as holograms into the user’s field of vision. Objects like the plans for an operation, for instance. “After an operation has been planned in mediCAD® 3D, you simply press a button and the data is prepared for use with Microsoft HoloLens 2,” Würdinger says. “With our assistance app for mediCAD® MR on the PC, the data can be enriched as required, for example with X-ray images or instructions for a new implant to be used for the operation.” Once the data has been prepared, the software generates a QR code; when the surgeon views this code with Microsoft HoloLens 2, the plans open in their field of vision.

Mr. Erdmann has talked to doctors who are already using the solution: “Anyone who has ever worn the Microsoft HoloLens 2 in the OR is convinced that it’s a real game-changer. They have the planned images right in front of their eyes at 1:1 size and in 3D, just like the patient, and can zoom in on tissue and bone structures, examine each individual layer, and rotate the view around any axis they wish.” Since the device is operated using voice commands and gestures, all this happens without contaminating the sterile environment. “We design our solutions so that they dovetail seamlessly with hospital workflows. With mediCAD® MR and Microsoft HoloLens 2, we have achieved this once again,’ summarizes David Würdinger.

A new feature that has recently become available is the remote connection. This allows people who have been granted access to follow the view that Microsoft HoloLens 2 streams from the operating room live and in a first-person perspective. It’s also possible to communicate with the surgeon. “This opens up a whole new set of possibilities,” Würdinger says. One is that other specialists are able to advise during complicated operations. When new types of implants are used, experts from the implant manufacturers are also often present. “Currently, these experts have to go all the way to the hospital just to spend five or ten minutes in the OR. Remote access simplifies this workflow immensely,” Würdinger says.

The solution also harbors great potential for training aspiring surgeons. It’s possible for mediCAD® MR to record operations, which is particularly useful for non-routine and thus rarely performed procedures. That way, students can discuss the operation step by step with their instructors afterwards. At present, hospitals using the solution do so only on an on-premises basis. But the goal is to tap the full potential of the Azure cloud platform. “Obviously, data protection, security, and reliability are top priorities for hospitals,” Erdmann says. “Microsoft fulfills all our requirements here in the cloud as well, for instance through services such as Azure confidential computing for data protection. As we set about developing the solution further, this gives us a massive cloud toolbox that we will definitely dip into in the future.”

“Anyone who has ever worn the Microsoft HoloLens 2 in the OR is convinced that it’s a real game-changer. . They have the plan images right in front of their eyes at 1:1 size and in 3D, just like the patient.”

Eric Erdmann, Head of Development, mediCAD Hectec

“We design our solutions so that they dovetail seamlessly with hospital workflows. With mediCAD® MR and Microsoft HoloLens 2, we have achieved this once again.”

David Würdinger, Product Manager, mediCAD Hectec