NavCog: Turn-by-Turn Smartphone Navigation Assistant for People with Visual Impairments or Blindness
Dragan Ahmetovic, Cole Gleason, Kris M. Kitani, Hironobu Takagi, Chieko Asakawa · 2016 · Proceedings of the 13th International Web for All Conference (W4A) · doi:10.1145/2899475.2899509
Summary
This extended abstract presents NavCog, an open-source iOS smartphone navigation system designed to assist people with visual impairments or blindness in navigating complex indoor and outdoor environments. While many blind people can independently traverse familiar routes by building cognitive maps through prolonged exploration and Orientation and Mobility (O&M) training, navigating unfamiliar places remains extremely challenging because environmental cues like signs, text, and landmarks are primarily visual. NavCog addresses this by using Bluetooth Low Energy (BLE) beacons installed every 6-12 metres along paths in the environment to achieve high-precision indoor localization — averaging 1.5 metres accuracy, significantly better than GPS or Wi-Fi positioning. The system architecture has three components: BLE beacons in the environment, a map server with a web-based editing interface, and the iOS NavCog app. Localization works through signal fingerprinting: received signal strengths (RSS) from multiple beacons are sampled at 1-metre intervals along every path and stored in a K-d tree data structure. The K-nearest neighbours algorithm then compares real-time beacon readings against the fingerprint map to determine the user's position. Importantly, all position computation happens on the mobile device, preserving user privacy without sharing location data with servers or third parties.
Key findings
NavCog provides turn-by-turn navigation guidance through vocal output (synthesized speech via VoiceOver) and sonification (clicking sounds that increase in frequency as the user approaches waypoints). The system communicates distance countdown, directional instructions at decision points (e.g., "rotate right"), confirmation sounds when the user is facing the correct direction based on gyroscope data, and arrival notifications. The app also supports context-specific accessibility information associated with mapped areas. The map server includes a web-based tool for creating and editing venue maps as JSON files containing floor plans, path topologies, and beacon fingerprinting data. Maps can be shared publicly through an open map server or loaded as private maps directly to devices. A key advantage of BLE beacons over alternative indoor positioning technologies (RFID tags, Wi-Fi, Visible Light Communication, tactile tiles) is that beacon installation requires no structural modifications to the environment. NavCog was released as open source and made available on the Apple App Store, enabling community contribution and deployment in new venues.
Relevance
NavCog represents a significant advance in indoor navigation assistance for blind and visually impaired users, addressing a gap that GPS-based solutions cannot fill. Indoor environments like shopping centres, hospitals, universities, and office buildings remain among the most challenging spaces for independent mobility without sight. The 1.5-metre average accuracy is precise enough for meaningful turn-by-turn guidance in corridors and building interiors. The open-source approach and web-based map editing tool lower the barrier for deploying navigation assistance in new venues — facility managers or accessibility advocates can map their own buildings without specialised technical knowledge. The privacy-preserving design (on-device computation with no location sharing) addresses a legitimate concern for assistive technology users. For accessibility practitioners, NavCog demonstrates that relatively low-cost beacon infrastructure combined with smartphone capabilities can provide the kind of navigation independence that has traditionally required either extensive personal familiarity with a space or accompaniment by a sighted guide.
Tags: indoor navigation · visual impairment · blindness · assistive technology · Bluetooth beacons · wayfinding · mobile accessibility · orientation and mobility