Speed-of-Light VR for Blind People: Conveying the Location of Arm-Reach Targets
Diogo Lança, Manuel Piçarra, Inês Gonçalves, Uran Oh, André Rodrigues, João Guerreiro · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2024) · doi:10.1145/3663548.3688533
Summary
This paper explores how blind people can locate and interact with close-range virtual objects in Virtual Reality (VR), a space that relies almost entirely on visual cues. Researchers from the University of Lisbon and Ewha Womans University adapted the arcade game Speed-of-Light — where players must quickly tap illuminated buttons on a grid — into an accessible VR application using the Meta Quest 2 headset. The original game's visual prompts were replaced with three non-visual techniques for conveying target locations: Speech Feedback (verbal announcements like "Top Right"), Sonification (3D spatial audio using pitch for vertical position and stereo panning for horizontal), and 2D Grid Position (spreadsheet-style coordinates like "A3"). The VR environment included additional accessibility features: haptic vibration in controllers that intensified as hands approached a target, and an on-demand help system triggered by the controller that gave directional hints relative to the player's hand position. The game was tested with both 3x3 and 4x4 grid configurations, with Speech Feedback limited to the smaller grid due to its verbosity scaling poorly. The study involved 15 blind participants aged 28-64, most with technology experience but limited prior VR exposure, who each spent approximately one hour playing timed rounds with all three techniques.
Key findings
Speech Feedback and 2D Grid Position significantly outperformed Sonification. On the 3x3 grid, Speech Feedback and 2D Grid Position produced similar scores (M=13.6 and M=13.8) compared to Sonification (M=8.8), though the difference was not statistically significant for score. Sonification required significantly more help requests (M=30.5 vs. M=12.8 and M=16.4, p<0.001). On the 4x4 grid, Sonification scored significantly lower than 2D Grid Position (M=4.6 vs. M=8.1, p=0.035). Preference rankings favoured 2D Grid Position (7 first-place votes) and Speech Feedback (6) over Sonification (2). However, the picture was nuanced: Speech Feedback was the most intuitive but too verbose for time-sensitive play — participants frequently hit the center button when "Middle Left" or "Middle Right" were announced because they acted before hearing the full instruction. 2D Grid Position worked well for spreadsheet and chess users but confused those unfamiliar with grid coordinates. Sonification, while hardest to use, was valued by some participants who enjoyed the additional challenge it brought to the game.
Relevance
This research contributes to the growing field of accessible VR, which is critical as virtual environments become more prevalent in education, social interaction, training, and entertainment. The study demonstrates that blind users can successfully locate and interact with objects in 3D virtual space using non-visual cues, challenging assumptions that VR is inherently visual. The comparison of three distinct feedback approaches offers practical design guidance: speech-based feedback works best for immediate usability but does not scale well, grid-based coordinates suit users with relevant mental models, and sonification needs refinement but offers engaging complexity. The multimodal support features — haptic proximity feedback and on-demand directional hints — proved valuable across all conditions and represent reusable design patterns. The work is limited by its small sample size, restriction to flat grids at arm's reach (rather than full 3D space), and the inherent challenge of testing only two grid sizes. Nevertheless, it provides a foundation for designing accessible spatial interactions in VR that extend beyond gaming to workplace, educational, and social applications.
Tags: virtual reality · visual impairments · blindness · nonvisual feedback · sonification · spatial awareness · gaming accessibility · exergames