Unmet NeedProjection mapping, also known as video mapping or spatial augmented reality, is a projection technology that turns 3D objects into a display target for projectors. There are several applications for this technology, ranging from educational purposes for teaching students to a medical application for anatomical study and surgeon cutting path in surgery. The impact of projection mapping is immense, yet there are a few shortcomings that need to be addressed for optimal application and practicality. In conventional projection mapping, both the projection and screen are fixed, causing there to be difficulty in using a large and heavy device that is not able to project images or videos anywhere in 3D space. There is an unmet need for a device that addresses the mobility, size, weight, and actual projected images or videos that result from its use. In addition, this device should not require a head mounted display as this limits mobility and application while also limiting access to patient data. There is an unmet for this device to be hand-held with augmenting capabilities to allow for transparent access to patient data.
Technology OverviewThe inventors have developed a novel Portable Projection Mapping Device (PPMD) that consists of a projector, video camera, depth camera, and inertia measurement unit (IMU). The images that are taken can project images or videos anywhere in 3D space, and can range from virtual internal tissues, surgical virtual plans, and virtual hardware. Other features of this hand-held device include being lightweight, small, and allowing multiple users to view the projection at the same time. It addresses several unmet needs of the types of images and videos that are allowed to be taken, the size and weight, and the improved practicality of the portable design. In addition, this device has augmenting capabilities so that patient data can be accessed at any point and be overlaid. Furthermore, this device can be used for educational purposes, in that it has the ability to overlay the internal anatomy on to a subject’s body for overall learning.
Stage of DevelopmentThe inventors have developed a prototype hand-held device consisting of a projector, video camera, depth camera, and inertia measurement unit. They are currently working on testing and implementation of this product.
