Research Terms
This mixed simulation teaching tool uses augmented reality to provide training in blind and guided medical procedures. In the United States, over 250,000 deaths per year are due to medical error, making it the third leading cause of death. Many of these instances owed to substandard care and would be preventable if healthcare professionals received proper training. Many medical procedures require placing an instrument like a needle inside a target while avoiding accidental contact or puncture of surrounding organs or tissues. For procedures such as these, verbal and written instruction, while necessary and worthwhile, cannot take the place of hands-on training. Researchers at the University of Florida have developed a mixed simulation system that allows medical training instructors to visualize and consistently score trainee performance. The simulation integrates sensors and augmented reality principles with physical and virtual medical image models, enabling the students to rehearse important medical procedures and to self-debrief without endangering human lives.
Mixed simulators with anatomically correct physical and virtual components that combine real-time 3D visualization with tracked instruments, recording and playback, and automated and consistent scoring algorithms to facilitate training of clinicians in procedural skills
This mixed simulation technology collocates anatomically authentic virtual and physical 3D objects that represent the part of the human body that is of interest. The simulation has already successfully applied to three procedures: central venous access (upper torso and neck), regional anesthesia (spine) and ventriculostomy (brain). In all three applications, a sensor with six degrees of freedom that is smaller than a grain of rice secures inside the needle bore near the needle tip such that, as the trainee directly manipulates and steers the needle, the needle tip position is traceable respective to both the physical and virtual components representing the human body. Real-time 3D visualization allows trainees and instructors to observe and critique technique and strategy. Because of the needle tip tracking, metrics heretofore unavailable facilitate implementation of automated and consistent scoring algorithms. These scoring algorithms open the possibility for self-debriefing when experts are not available to provide feedback. CT and MRI scans of individual humans along with 3D files of discrete objects that represent different organs and tissues facilitate the physical and virtual imaging. 3D files fed into a 3D printer (fast prototyping machine) create the physical parts of the mixed simulation. The system integrates readily available commercial off-the-shelf components into turnkey (set up time of about seven minutes) simulation systems that are compact and lightweight (meeting airline checked luggage requirements).
Facilitates the Training of Clinicians in Procedural and Cognitive Skills Using 3D Color Visualization
This mixed simulator technology is especially suited for training in blind and guided medical procedures. This teaching tool uses augmented reality principles similar to the yellow first-down line on TV football games and has the potential to improve patient safety. The technology seamlessly integrates numerous exponential technologies, such as medical imaging, miniature 6 degrees of freedom (DOF) sensors smaller than a grain of rice and 3D printers to collocate (superpose, overlay or underlay) physical and virtual systems that are anatomically correct replicas of individual humans.The Institute of Medicine has estimated that medical errors kill more people than motor vehicle accidents, breast cancer and AIDS combined. Many of these adverse events were attributed to substandard care and could have been prevented if healthcare professionals had been properly trained. Verbal and written instruction, while necessary and worthwhile, cannot take the place of hands-on training. Alternatively, practicing on human patients is unconscionable. This simulator allows instructors to visualize and consistently score trainee performance, while students can rehearse and self-debrief without endangering human lives.
Mixed simulators with anatomically correct physical and virtual components that combine real-time 3D visualization with tracked instruments, recording and playback, and automated and consistent scoring algorithms to facilitate training of clinicians in procedural skills
Many medical procedures require placing an instrument like a needle inside a target such as a vein while avoiding accidental contact or puncture of surrounding organs or tissues. The mixed simulation technology developed by UF researchers collocates anatomically authentic virtual and physical 3D objects that represent the part of the human body that is of interest. The technology has already been successfully applied to three procedures: central venous access (upper torso and neck), regional anesthesia (spine) and ventriculostomy (brain). In all three applications, a 6 DOF sensor smaller than a grain of rice is fixed inside the needle bore near the needle tip such that, as the trainee directly manipulates and steers the needle, the needle tip position can be tracked respective to both the physical and virtual components representing the human body. Real-time 3D visualization can be turned on to allow trainees and instructors to observe and critique technique and strategy. Because of the needle tip tracking, metrics heretofore unavailable are provided that facilitate implementation of automated and consistent scoring algorithms. These scoring algorithms open the possibility to self-debriefing when experts are not available to provide feedback. Individual humans were scanned using CT and MRI and 3D files consisting of discrete objects representing different organs and tissues were created. The physical parts of the mixed simulation are created by feeding the 3D files to a 3D printer. The technology integrates readily available commercial off-the-shelf components into turnkey (set up time of about seven minutes) simulation systems that are compact and lightweight (meeting airline checked luggage requirements).
Dept of ANES 1345 SW Center Drive PO BOX 100254 GAINESVILLE, FL 32610-0254
