Haptic Gloves for Audio-Tactile Web Accessibility
Andrii Soviak · 2015 · Proceedings of the 12th International Web for All Conference (W4A) · doi:10.1145/2745555.2746671
Summary
This doctoral consortium paper proposes FeelX, a haptic glove system that would enable blind users to explore web page layouts through touch on any flat surface such as a desk or table. The core problem is that screen readers linearise web pages into a one-dimensional sequence of content, losing all two-dimensional spatial layout information — section positioning, visual hierarchy, the grouping of related elements. The author argues that haptic interfaces could provide a paradigm shift in non-visual web browsing by engaging multiple simultaneous tactile channels (one per finger), allowing users to feel webpage sections, text lines, links, and buttons. Rather than waiting for full tactile screens to become available, the proposed gloves attach small Braille cells (2x8 pin matrices with piezoelectric actuators, 2.5mm pin spacing) to the pad of each fingertip — the distal phalanx, the most sensitive part of the finger. A camera above the desk tracks finger positions via infrared LEDs using OpenCV computer vision, and an Interface Manager maps finger coordinates to browser screen coordinates via a browser plug-in. The system integrates with standard screen readers, triggering audio narration of content under the user's fingers while simultaneously providing tactile feedback about page structure.
Key findings
A preliminary user study with 10 blind participants validated the desirability of tactile feedback for web browsing. In the absence of electronic haptic hardware, embossed plastic overlays were attached to an iPad 2 screen, rendering web page sections as raised tactile boxes. Participants completed browsing tasks slightly faster with overlays (mean 6.5 min/task vs 7 min/task without), and rated the overlay condition significantly higher on usability (mean SUS score 76 vs 65.5 — scores above 70 are considered good). Participants agreed (average Likert rating 4.3/5) that overlays helped them understand webpage layouts. Several behavioural observations informed the glove design: most participants used both hands to explore layouts, confirming the need for bimanual gloves; participants spontaneously used gestures with the overlays, indicating gesture support is needed; and participants performed better on pages with sparser tactile information, confirming the need for larger work surfaces with zoom capability and more spacing between tactile elements. The FeelX architecture includes five components: Camera, Finger Tracker, Controller, Haptic Gloves, and Interface Manager. Each finger also has a pressure sensor (button) for input. The system addresses the "fat finger" problem of touchscreens by using a larger desk-sized work area.
Relevance
This paper tackles a fundamental limitation of current screen reader technology: the loss of spatial layout information when web pages are linearised into audio streams. For sighted users, spatial layout conveys meaning — grouping, hierarchy, relative importance — that blind screen reader users simply never receive. The embossed overlay study, while simple, provides concrete evidence that blind users want and benefit from spatial awareness of web pages, not just sequential content access. The glove approach is creative in sidestepping the prohibitive cost of full tactile displays (like BrailleDis 9000) by distributing small Braille cells across fingertips moving over a desk surface. For practitioners, the key takeaway is that web page structure and visual layout carry significant information that current accessibility approaches fail to convey. However, this is a proposal paper — the FeelX gloves themselves had not been built at the time of writing. The preliminary study used static embossed overlays, not dynamic electronic feedback. Practical challenges include the complexity of the hardware setup (camera, LEDs, piezoelectric cells on every finger), potential discomfort of wearing instrumented gloves, and whether the approach can scale to complex modern web pages.
Tags: blindness · haptic technology · tactile interface · screen reader · web accessibility · wearable technology · web page segmentation · braille display · computer vision