3D Sound Interactive Environments for Problem Solving
Jaime Sánchez, Mauricio Sáenz · 2005 · Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '05) · doi:10.1145/1090785.1090817
Summary
This paper from the University of Chile presents AudioChile, a 3D sound virtual environment designed to help children with visual disabilities develop problem-solving skills through interactive exploration of Chilean geography and culture. AudioChile is a role-playing game composed of diverse hyperstories set across three Chilean geographical regions — Chiloé, Valparaíso, and Chuquicamata — each represented as a labyrinth that users navigate through 3D sound and stereo audio. Children adopt a personage (boy or girl) and navigate virtual worlds by interacting with objects and characters, following cues to solve problems such as finding a lost copper ingot in Chiloé and returning it to Chuquicamata. The system maps objects to cardinal sound directions (north, south, east, west), uses environmental sounds to indicate terrain types and boundaries, and provides audio feedback for all actions. Interaction uses a force feedback joystick and keyboard, with actions including take, give, open, push, pull, look, speak, use, travel, and check backpack. The software architecture follows a model-based approach with components for knowledge representation, a learner model that tracks the child's progress, an AI strategy component providing compass-like orientation, evaluation, and projection for 3D rendering.
Key findings
Six Chilean children with visual disabilities (ages 10-15, three with low vision and three totally blind) participated in usability testing across four sessions over four months. Children with residual vision showed high motivation scores (9-10 out of 10) across all metrics including likability, pleasantness, challenge, activeness, replay desire, and motivation. Blind children scored lower but still positively (7-9 range), with controlling the software and ease of use being more complex for them. Sound acceptance was very high for both groups (scores 9-10), confirming that audio-based interfaces can effectively convey spatial and navigational information. The iterative design process revealed important findings: initial 2D icon-based interfaces designed by sighted developers were not appropriate for children with residual vision and had to be redesigned as 3D representations; sounds for opposite actions needed to be inversions of each other (e.g., opening/closing sounds); circular menus with one function per screen worked better than complex menus for keyboard-based navigation; and children needed more cues and instructions than initially expected to orient themselves in the virtual environment. After redesign, software acceptability scores increased across all measures.
Relevance
This study demonstrates that 3D audio virtual environments can serve as effective cognitive learning tools for children with visual disabilities, not just entertainment. The use of spatial sound for navigation, orientation, and problem-solving builds skills that transfer to real-world spatial reasoning — laterality, cardinal direction awareness, and mental mapping. For accessibility practitioners, AudioChile illustrates several important design principles for non-visual software: the value of iterative usability testing with the actual target population (children with visual disabilities provided fundamentally different feedback than sighted designers expected); the importance of distinguishing between residual vision and total blindness as separate design requirements; and the need for audio-first design rather than visual design with audio added. The finding that environmental sounds can effectively convey complex spatial relationships and terrain information has broad implications for accessible navigation systems, educational software, and audio games for blind users.
Tags: spatial audio · visual impairment · blindness · audio game · cognitive development · problem solving · education · game accessibility · non-visual interaction · children