System for Automated Measurement of Spatial-cognitive Abilities

Unmet Need:  Early developing spatial ("block-building") skills may be crucial for later academic achievements.
Despite the importance of block-building skills, there has been very limited development of methods to precisely quantify their nature.  Although block play is one of the most accessible and ubiquitous activities engaged in by young children, block construction is remarkably complex, tapping into a range of different cognitive skills.  Importantly, this complexity is not directly captured in standard techniques of measuring block construction ability; rather, children’s block construction is typically quantified by using standardized tests that yield a score capturing overall accuracy

Technology Overview:  A data collection system using low-cost RGBD cameras (e.g., Microsoft Kinects) and wireless inertial measurement units (IMUs) captures a subject’s motions in the block-building task. One or more RGBD cameras are placed above the user’s workspace; these are positioned to capture the entire setup to minimize the impact of occlusion. Additionally, one or more wireless IMUs are embedded in the blocks used for the block-building task. Readings from the wireless IMUs and RGBD cameras are recorded and synchronized in time. In some embodiments, IMUs are also attached to the subject’s hands, providing an independent measurement of hand motion.

Stage of Development: The above system has been reduced to practice at JHU with a significant sample size for practical implementation.

Category(s):