A Mobile Interactive Maps Application for a Visually Impaired Audience
Nikolaos Kaklanis, Konstantinos Votis, Dimitrios Tzovaras · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/2461121.2461152
Summary
This demo paper presents "Open Touch/Sound Maps," an Android mobile application that makes interactive maps accessible to visually impaired and blind users through multimodal feedback. Web-based spatial information resources like OpenStreetMap are inherently visual, leaving blind and low-vision users with extremely restricted access. The application addresses this by allowing users to explore any map area supported by OpenStreetMap simply by moving their finger over the touch screen, receiving real-time audio and haptic feedback about the geographic features beneath their fingertip. The system combines three feedback modalities: sonification (different sounds for different map elements like roads, buildings, and water), text-to-speech output (announcing place names, street names, and points of interest), and vibration feedback (providing tactile confirmation of boundaries and transitions between features). Unlike previous accessible map systems that were limited to predefined map areas or required specialized hardware like force-feedback mice or tactile paper overlays, this application works with any map area worldwide using only a standard Android smartphone or tablet.
Key findings
The application represents a significant advance over prior work in several ways. Previous multimodal map systems such as PocketNavigator (tactile pedestrian navigation), Haptic GeoWand (vibration-based orientation via GPS), and 3D-Finger (image recognition on tactile paper maps) were either limited to predefined areas, required special equipment, or focused only on navigation rather than exploration. Open Touch/Sound Maps is claimed to be the only Android application at the time that combined vibration, sonification, and speech feedback for free-form map exploration on a standard mobile device. The system retrieves OpenStreetMap data in real time and renders it with multimodal output, enabling users to build spatial mental models of any geographic area. The use of commodity smartphones and tablets rather than specialized hardware makes the technology immediately available to a wide user base. The paper is a short demo description and does not include formal user evaluation results.
Relevance
This work addresses a fundamental accessibility gap: the overwhelming visual orientation of digital maps excludes blind and visually impaired users from spatial information that sighted users take for granted. For accessibility practitioners, the multimodal approach — combining audio, speech, and haptic channels — demonstrates how non-visual alternatives can convey inherently spatial information. The use of open data (OpenStreetMap) and commodity hardware (standard Android devices) is a practical model for accessible tool development, avoiding the cost barriers of specialized equipment. While the paper lacks formal evaluation with blind users, it represents an early example of the kind of accessible map exploration tools that have since become increasingly important as location-based services proliferate. The work highlights that map accessibility requires not just screen reader compatibility but fundamentally different interaction paradigms.
Tags: visual impairment · accessible maps · sonification · haptic feedback · mobile accessibility · multimodal interaction · text-to-speech · blindness · navigation