Lorraine Cruz|they/them
Home Works Email
EmpoweredAR (2024)
DATE: 2024
MEDIUM: XR GLASSES PROTOTYPE
EmpoweredAR was inspired by the challenge of making augmented reality (AR) technology accessible beyond entertainment and education, specifically aimed at aiding visually impaired individuals. The project utilizes Xreal lenses to create a digital mesh of the environment, which, coupled with auditory signals, provides spatial awareness to users. This enables them to navigate around obstacles safely. Developed with Unity for audio playback, TensorFlow and YOLOv3 for object detection, and XREAL glasses for depth data, the project faced challenges such as the absence of an RGB camera in the lenses, complicating the differentiation of obstacles. Despite these challenges, the team successfully implemented dynamic object detection. Key learnings included XREAL development, TensorFlow/YOLOv3 usage, and spatial audio techniques in Unity. Future plans involve integrating AI to enhance object identification and navigation in more complex and dynamic environments. This initiative represents a significant step in transforming AR into a tool that empowers visually impaired individuals to confidently explore their surroundings, showcasing the project’s blend of technical innovation and social impact. The code and further details are available in our repository: https://codeberg.org/reality-hack-2024/TABLE_72.
https://devpost.com/software/empoweredar#updates