Finger Dance: A Sound Game for Blind People
Daniel Miller, Aaron Parecki, Sarah A. Douglas · 2007 · Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '07) · doi:10.1145/1296843.1296898
Summary
This paper from the University of Oregon presents Finger Dance, an original audio-based rhythm-action game designed specifically for visually impaired players. The authors take a different approach from the usual sensory substitution strategy (replacing visual elements with audio/haptic equivalents in existing visual games). Instead, they target a game genre that is inherently audio-based — musical rhythm-action games like Dance Dance Revolution and Guitar Hero — but which still rely on visual cues to tell players when and how to press keys. In Finger Dance, players listen to music and match rhythmic patterns with keystrokes. Drum rolls using MIDI percussive sounds define the cues: they start playing one beat, half a beat, or a quarter beat before the player must press a key, and stop on the beat requiring the keystroke. The pitch and speaker location of the drum roll indicates which of four keys (Q, A, W, S) to press. A clap sound confirms correct timing, while an error sound plays for wrong keys. The menu system uses synthesised voice from Cepstral LLC for natural pronunciation, with navigation based on left/right arrow keys and enter — designed following IGDA accessibility guidelines and community input from blind gamers on forum.audiogames.net.
Key findings
Usability testing with three sighted participants on the first prototype revealed that the game was too difficult for some and the synthesised menu voice was hard to understand, but users quickly grasped the navigation and appreciated sound effects for keystroke feedback. They found the game fun and challenging enough for repeated play. A second prototype improved cue presentation (synthesised waveforms instead of percussive sounds) and the voice, with constant rather than variable cue timing. Three blind gamers who tested the second prototype via audiogames.net reported finding the games and concept enjoyable, menu navigation very easy, but the second prototype harder to play than the first — they preferred the original percussive sounds. Blind testers provided many suggestions about sound cues and how to make other versions. The scoring system records timing accuracy (whether keystrokes are early or late relative to the beat) in addition to correctness, enabling analysis of different play styles and game/cue effectiveness. The human-centred development approach — engaging blind gaming communities from early in the project — was essential for discovering preferences that differed from developer assumptions.
Relevance
This paper demonstrates an important principle for accessible game design: rather than trying to make inherently visual games accessible through sensory substitution (which often produces a diminished experience), designers should identify game genres that are naturally suited to non-visual interaction and build accessible versions from the ground up. Rhythm-action games are an excellent fit because the core gameplay — matching inputs to musical beats — is fundamentally auditory. For practitioners, the finding that blind testers preferred the original percussive drum sounds over the "improved" synthesised waveforms is a valuable reminder that developer assumptions about what constitutes improvement may not match user preferences, reinforcing the need for participatory design with the target community. The project also highlights the audiogames.net community as a significant resource for blind gaming culture and user research, and the IGDA accessibility guidelines as a practical framework for accessible game development.
Tags: audio game · game accessibility · blindness · rhythm-action game · sensory substitution · inclusive design · human-centred design · MIDI · accessible gaming