A Method for Image to World Registration for Medical Augmented Reality Applications Using a World Spatial Map

Unmet Need
Due to the 2 dimensional nature of fluoroscopic imaging, when performing surgery aided by X-rays, surgeons are required to undergo serious mental gymnastics to situate themselves and their tools in flat images. Historically, doctors have used visual markers such as wires or drawn lines to aid in depth perception and place themselves accurately in relation to the patient. These methods, while better than nothing, are inaccurate and rely on the doctor’s ability to make up the difference between what they see on the screen and what exists in real-life, while simultaneously performing surgery.

Technology Overview
Researchers at Hopkins have developed a new method to guide surgeons while performing fluoroscopic surgeries by utilizing augmented reality in congruence with spatial mapping and world registration. By first mapping the surgical environment and then identifying the position of the patient within the larger context of the operating room, the technology is able to synthesize an extremely precise augmented reality structure that is streamed directly to a head-mounted display. That augmented reality display provides 3 dimensional markers capable of situating surgeons and their tools within 2 dimensional, fluoroscopic images. Additionally, this technology could be utilized to provide vital information (e.g., blood pressure, oxygen saturations, time) to the surgeon constantly throughout the procedure. X-ray aided surgery continues to grow in popularity and this technology has the potential to make those procedures safer and easier.

Stage of Development
Proof of concept, early stage prototype.

Publications
On-the-fly Augmented Reality for Orthopedic Surgery Using a Multi-Modal Fiducial

Category(s):