Getting Smartphones to Talkback: Understanding the Smartphone Adoption Process of Blind Users
André Rodrigues, Kyle Montague, Hugo Nicolau, Tiago Guerreiro · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility · doi:10.1145/2700648.2809842
Summary
This paper presents an eight-week longitudinal study investigating how novice blind users adopt touchscreen smartphones, transitioning from traditional feature phones. The researchers recruited five legally blind participants (ages 23-55) who had never used a touchscreen smartphone but were experienced with desktop screen readers. Each participant received a Samsung S3 mini with Android 4.1 and TalkBack pre-installed, replacing their existing Nokia feature phones. The methodology combined multiple data sources: pre-adoption interviews exploring concerns and expectations, an initial TalkBack tutorial session, weekly 30-60 minute sessions with controlled task assessments and interviews, continuous in-the-wild usage logging via a custom service (TinyBlackBox) that captured 7,175 interaction sessions, and post-study interviews. This mixed-methods approach allowed researchers to capture both objective performance data and subjective experiences over time. Pre-adoption, participants expressed concerns about cost, security risk of carrying expensive devices in public, and fundamental doubts about operating a device without physical keys. They questioned whether touchscreens were "designed for them" at all. Despite these concerns, participants felt socially compelled to adopt smartphones as feature phones disappeared from the market.
Key findings
The TalkBack tutorial proved remarkably ineffective—only 1 of 5 participants completed all four lessons. The tutorial disabled screen interaction during explanations, frustrating users who wanted control over their learning pace. It failed to recognize successful and unsuccessful task attempts, leaving users confused about whether they had performed gestures correctly. The L-shaped gesture required for context menus was particularly problematic; 4 of 5 participants could not consistently perform it even after 15 attempts. Barriers evolved throughout the study but never fully subsided. Initial weeks focused on basic gesture execution (double-tap timing, accidental touches) and distinguishing touchscreen boundaries from capacitive buttons. Later barriers shifted to application-specific accessibility issues—unlabeled buttons, navigation inconsistencies between apps, and understanding the conversation-based SMS paradigm versus traditional Inbox/Sent folders. Weekly task assessments revealed highly variable learning curves. "Check time" was mastered by week 1, but "Add Contact" took until week 4-6, and "Send new Message" until week 5-7. Participants developed coping strategies: asking sighted helpers, rebooting when confused, completing tasks on secondary devices, or memorizing button positions relative to physical landmarks. Despite ongoing struggles, participants valued their smartphones. They used apps like CamFind to identify medications, accessed email independently, and saw devices as supporting their social inclusion. By week 8, even the most skeptical participant (P5) stated: "They aren't that hard, as everything else we just need to learn to use them."
Relevance
This research has critical implications for mobile accessibility practitioners and platform developers. The failure of TalkBack's built-in tutorial highlights a broader problem: onboarding tools designed for sighted users are inadequate for non-visual learners. The tutorial's approach of interrupting interactions for lengthy explanations, failing to confirm gesture success, and teaching gestures without explaining their effects left users without a mental model of the interface. The finding that barriers evolve rather than disappear suggests accessibility testing limited to initial contact misses significant real-world challenges. Lab-based studies of specific tasks (text entry, gesture performance) don't capture the compound difficulties of navigating app ecosystems, handling inconsistent navigation patterns, or recovering from errors without sighted assistance. For practitioners, the study emphasizes the importance of human support networks in technology adoption. Participants' primary coping strategy was asking friends and family for help—but sighted helpers unfamiliar with TalkBack sometimes provided incorrect guidance. This suggests opportunity for peer mentorship programs connecting novice and experienced blind smartphone users. The research also documents how smartphones became "more than phones" for participants—tools for independence (medication identification, navigation), social connection (WhatsApp, Facebook), and entertainment—even when basic phone tasks remained slower than on feature phones. This trade-off between functionality breadth and task efficiency should inform how we evaluate mobile accessibility.
Tags: blindness · screen readers · mobile accessibility · TalkBack · smartphone adoption · touchscreen · longitudinal study · Android