Sensory Glasses for the Visually Impaired
Michael Barney, Jonathan Kilner, Gilmar Brito, Aida Araújo, Meuse Nogueira · 2017 · Proceedings of the 14th International Web for All Conference (W4A) · doi:10.1145/3058555.3058584
Summary
This demonstration paper presents the design and development of a low-cost wearable assistive device — sensory glasses — intended to help visually impaired people navigate their surroundings. The device addresses a well-known limitation of the traditional white cane: it cannot detect obstacles above waist height, which are common in urban environments and can cause injury. Guide dogs offer an alternative but are prohibitively expensive and require extensive training for both the animal and the user. The sensory glasses use five ultrasonic sensors mounted on a glasses frame at positions covering left, upper-left, front, upper-right, and right directions. These sensors measure distances to surrounding objects using the pulse-echo principle. An Arduino microcontroller processes the sensor data and transmits the calculated distances via Bluetooth to an Android smartphone. The smartphone application, built in Android Studio, converts these distance measurements into 3D binaural sound. Each sensor direction is mapped to a distinct audio frequency with different left/right channel proportions, creating a spatial soundscape. The volume for each sensor is inversely proportional to the measured distance, providing an intuitive sense of depth — closer objects produce louder sounds. Through this spatial audio representation, users can mentally map their environment and detect obstacles that would be missed by a cane alone.
Key findings
Initial evaluation with visually impaired volunteers showed that users could understand the device and begin perceiving object distances within approximately 30 minutes of introduction. While stationary, users could detect objects approaching from all sensor-covered directions. However, testing revealed that the glasses alone were insufficient for walking navigation — users still needed a white cane to detect obstacles below the glasses'field of vision, positioning the device as a complement to rather than a replacement for existing mobility aids. The training protocol involved a gradual approach: users started with only the frontal sensor and incrementally added pairs of sensors, with the audio sweep velocity increasing as comfort grew. The use of a standard smartphone for audio processing kept costs low, leveraging the fact that most blind people already own mobile phones. The researchers noted that attending to both the device audio and ambient environmental sounds was challenging initially but achievable with practice, consistent with research showing that blind people have heightened sensitivity to binaural sound-location cues.
Relevance
This work represents an early prototype in the growing field of wearable navigation aids for blind people, with relevance to how sensory substitution technologies can complement traditional mobility tools. For accessibility practitioners, the key takeaway is that assistive navigation devices are most effective when designed as part of a toolkit rather than standalone solutions — the glasses work best alongside a white cane, covering the upper-body detection gap the cane cannot address. The use of commodity hardware (Arduino, smartphone, ultrasonic sensors) demonstrates that functional assistive prototypes can be built affordably, an important consideration for accessibility in low-resource contexts. The paper's future work section envisions IoT integration — connecting the glasses to smart infrastructure like traffic lights — which points toward the broader trend of smart cities needing to consider accessibility in their design. The research is limited by its very small participant pool and early-stage evaluation, but it contributes to the conversation about multimodal navigation assistance.
Tags: assistive technology · blindness · wearable technology · sonification · navigation · sensory substitution · binaural audio