Echolocation as a Means for People with Visual Impairment (PVI) to Acquire Spatial Knowledge of Virtual Space
Ronny Andrade, Jenny Waycott, Steven Baker, Frank Vetere · 2021 · ACM Transactions on Accessible Computing · doi:10.1145/3448273
Summary
This study investigates whether echolocation—the use of sound reflections to perceive spatial information—can enable people with visual impairment (PVI) to acquire spatial knowledge of virtual environments. The researchers built a virtual world using Unity 3D and the SteamAudio plugin, which simulates physics-based sound propagation including absorption, reflection, and occlusion based on virtual materials. Twelve participants who were blind or had visual impairments (9 completely blind, 2 with light perception, 1 with low visual acuity) completed a two-part within-subjects experiment. Part one assessed landmark knowledge through five scaffolded levels testing participants' ability to identify: room materials (carpet, wood, metal), relative room sizes, 90-degree turns, wall openings, and obstacles. Three echolocation methods were provided: two artificial clicking sounds synthesized from recordings of expert human echolocators, and natural footstep sounds generated by the avatar walking. Part two assessed survey knowledge by having participants freely explore a virtual space for 30 minutes and then create a clay model reconstruction of the layout. Post-experiment interviews gathered qualitative insights about participants' experiences and opinions.
Key findings
Participants successfully identified several virtual space features through echolocation, with varying success rates: materials (75%), 90-degree turns (71%), and room sizes (64%) were significantly easier to detect than openings (40%) and obstacles (43%). A key qualitative finding was that participants strongly preferred footstep echoes over artificial clicking sounds for obtaining spatial information—echoing real-world echolocation practice where footsteps and cane taps complement active mouth clicks. As one expert echolocator participant explained: "clicking is something I do on a longer range information. The shorter range information... is there an entrance, is there a wall, all that stuff is usually just from the cane or from walking." In the reconstruction task, 4 of 12 participants produced accurate clay models of the virtual space, while 9 correctly identified the presence of two rooms and 6 identified the connecting corridor. Participants reported feeling a genuine sense of presence in the virtual space, with several noting that the experience felt similar to exploring a physical room. Many expressed interest in using echolocation-enabled virtual worlds both for orientation and mobility training and for entertainment.
Relevance
This is the first study to systematically evaluate echolocation for spatial knowledge acquisition with actual PVI participants rather than blindfolded sighted individuals—an important methodological choice that recognizes the unique skills PVI develop through lived experience. The finding that footsteps are more useful than artificial clicking sounds has immediate practical implications: footsteps are already standard in most 3D games, so enabling echolocation may require enhancing existing audio rather than adding new sounds. For game developers, the scaffolded approach—starting with simpler perceptual tasks before complex spatial mapping—provides a model for onboarding PVI players. The research suggests that echolocation-enabled virtual environments could serve dual purposes: as safe training grounds for real-world orientation skills and as accessible entertainment. The study demonstrates that with appropriate audio design, 3D virtual worlds can be made spatially comprehensible to PVI, potentially unlocking mainstream gaming experiences that have been inaccessible due to their visual nature.
Tags: visual impairment · blindness · echolocation · virtual reality · gaming · spatial knowledge · mental maps · audio games · game accessibility