Interactive Flying Frustums (IFFs) for Spatially-aware Surgical Data Visualization

Unmet Need
Due to the 2 dimensional nature of fluoroscopic imaging, when performing surgery aided by X-rays surgeons are required to undergo serious mental gymnastics to situate themselves and their tools in flat images. Historically, doctors have used visual markers such as wires or drawn lines to aid in depth perception and place themselves accurately in relation to the patient. These methods, while better than nothing, are inaccurate and rely on the doctor’s ability to make up the difference between what they see on the screen and what exists in real-life, while simultaneously performing surgery.

Technology Overview
Utilizing augmented reality in congruence with interactive flying frustums researchers at Johns Hopkins have developed a new method to guide surgeons while performing fluoroscopic surgeries. Utilizing interactive flying frustums to map the operating room the technology is able to synthesize a precise augmented reality structure streamed directly to a head-mounted display. That augmented reality display would provide 3 dimensional ergonomic markers capable of situating surgeons and their tools within 2 dimensional, fluoroscopic images. Additionally, this technology could be utilized to provide vital information (e.g. blood pressure, oxygen saturations, time, etc…) to the surgeon constantly throughout the procedure. X-ray aided surgery continues to grow in popularity, this technology has the potential to make those procedures safer, easier, and reduce potential risk factors.

Stage of Development
Early prototype, proof of concept
 

Category(s):