Exploring the SoundVizVR Plugin in the Development of Sound-Accessible Virtual Reality Games: Insights from Game Developers and Players
Yuxin Li, Roshan Lalintha Peiris · 2024 · Proceedings of the ACM on Human-Computer Interaction (CSCW) · doi:10.1145/3698882
Summary
This paper presents SoundVizVR, a Unity plugin designed to make virtual reality games accessible to deaf and hard of hearing (DHH) users by visualizing in-game sounds. The research addresses a significant gap in VR accessibility—while visual content has received attention through features like subtitles and sign language avatars, sound accessibility in immersive VR environments remains underexplored. The plugin builds on four key design principles: differentiating sound characteristics (location, distance, priority), distinguishing sound types (ambient, event, dialogue), using intuitive and non-intrusive visuals, and providing customization options. SoundVizVR implements two complementary visualization systems: Mini-Map indicators that appear at the periphery of the user's view showing sound direction using arrow-shaped icons with varying sizes and colors to indicate distance and priority; and On-Object indicators that attach directly to sound-emitting objects in the game world, using color-coded halos (orange for event sounds, blue for ambient, green for dialogue) with animated rings to show sound activity. The plugin categorizes sounds into diegetic (originating from the game world) and non-diegetic (interface sounds), applying different visualization strategies for each. The researchers conducted two studies: a week-long deployment study with two experienced Unity developers who integrated the plugin into their existing VR games, and a user evaluation with 15 participants (10 DHH, 5 hearing) who played the modified games. This dual-perspective approach—examining both developer experience and player experience—provides valuable insights into the practical challenges of implementing sound accessibility in VR game development.
Key findings
Developer integration proved highly feasible, with both developers successfully implementing the plugin within a week despite no prior accessibility experience. System Usability Scale scores were excellent (82.5 and 90), and developers reported the plugin changed their attitudes toward accessibility, viewing it as more achievable than previously assumed. Key developer insights included the need for early accessibility planning during game design rather than retrofitting, and the importance of adapting visualizations for different game genres and contexts. Player evaluations revealed that DHH participants could effectively use the sound visualizations to locate sound sources, understand environmental audio, and engage with game mechanics that would otherwise be inaccessible. Mini-Map indicators were particularly valued for spatial awareness, while On-Object indicators helped identify active sound sources in complex scenes. However, some concerns emerged: players worried about visual distraction during intense gameplay, potential spoilers when visualizations revealed hidden enemies, and game balance issues when sound visualizations provided advantages in competitive scenarios. The research identified important design tensions: effective sound visualization must balance informativeness with avoiding cognitive overload, maintain game challenge while ensuring accessibility, and integrate naturally with diverse visual art styles. Customization emerged as essential—players wanted control over indicator visibility, size, and which sound types to display based on personal preferences and game contexts.
Relevance
This research provides a practical, open-source tool for VR game developers seeking to implement sound accessibility, lowering the barrier to creating DHH-accessible experiences. The finding that developers with no accessibility background could successfully integrate the plugin within a week suggests that technical complexity need not be a barrier to VR accessibility—what's often lacking is awareness and tools rather than capability. For accessibility practitioners, the study highlights the importance of involving both developers and end users in accessibility tool evaluation. Developer adoption and usability are prerequisites for any accessibility solution reaching users, making the developer experience a critical consideration often overlooked in accessibility research. The identified design tensions—between information richness and cognitive load, between accessibility and game balance—offer valuable considerations for any project involving sensory substitution or alternative modalities. The emphasis on customization aligns with broader accessibility principles: no single solution works for all users, and providing options allows individuals to adapt tools to their specific needs and contexts. The plugin is available as open-source, enabling other researchers and developers to build upon this work.
Tags: VR accessibility · deaf and hard of hearing · sound visualization · game development · assistive technology · Unity plugin