AR System for Hands-On, Realistic Training Outside the Classroom

Abstract

The University of Central Florida invention enables students to safely train for and to practice skills needed for various environments such as laboratories, industrial areas, and hospitals. An advanced augmented reality (AR) apparatus, the invention integrates various technologies to provide an enhanced user experience through visual, tactile, auditory, olfactory, and other sensory feedback mechanisms. The system uses video see-through augmented reality (VST-AR) capabilities, leveraging hardware and software components to achieve a realistic and interactive environment for learning and training in areas such as biochemistry, forensic chemistry, geochemistry, and physics-related studies (optics, thermodynamics, and acoustical).

Corporal entities (glassware replicas made of plastic or other polymers) afford the physical qualities and motor skills associated with using objects and equipment such as standard chemistry lab glassware. At the same time, AR technologies enable users to perform and safely experience simulated procedures like those in a laboratory, including chemical reactions—even unsafe reactions.

Additionally, the invention addresses temporal and geographic constraints associated with traditional lab and training systems, enabling students and trainees to engage in interactive and immersive learning experiences regardless of their physical location or time zone. This flexibility allows for continuous and accessible education, reducing the need for centralized, time-bound, and location-specific resources while maintaining the quality and safety of hands-on training.

Technical details: The UCF invention features a VST-AR device that captures images of a real-world environment and displays augmented versions on a screen. In one example application, the system includes a corporal entity, such as an empty laboratory vessel, with a unique identification marker to provide real-time spatial data for generating visual augmentations of virtual matter within the vessel. A marker can be a QR code, RFID tag, or near-field communication (NFC) chip affixed to the vessel surface.

The apparatus integrates various sensors, including an inertial measurement unit (IMU), capacitive tactile sensors, and a thermal diode, to dynamically adjust visual augmentations based on user interactions. Additional sensory enhancements include an olfactory output fan, an eccentric rotating mass (ERM) motor, and auditory outputs. Wireless connectivity via IEEE 802.11 (Wi-Fi) and IEEE 802.15.1 (Bluetooth) ensures seamless communication between components.

Real-time tracking allows the AR system to adjust digital augmentations, ensuring that they remain accurately overlaid on the physical object. This dynamic interaction is essential for applications requiring precise alignment, such as virtual training environments, interactive educational tools, and industrial maintenance systems.

Benefit

Market Application