Reviews

Search results

• Situated Understanding of Errors in Older Adults' Interactions with Voice Assistants: A Month-Long, In-Home Study

  Amama Mahmood, Junxiang Wang, Chien-Ming Huang · 2026 · ACM Transactions on Accessible Computing

  This month-long field study examined how 15 older adults (ages 66-94) interact with voice assistants in their homes, with a particular focus on errors and conversational breakdowns. The researchers deployed Amazon Echo Dot smart speakers augmented with custom audio recording…

  voice assistants · older adults · conversational AI · errors · smart speakers

• Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter

  Xinru Tang, Jingjin Li, Shaomei Wu · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Tang, Li, and Wu present the first study to push the 'disability-first' principle beyond dataset collection and into the dataset annotation stage of the AI pipeline. Their case is stuttered speech: despite a growing number of stuttering datasets (FluencyBank, UCLASS, KSoF,…

  AI dataset annotation · stuttering · speech recognition · disability-first design · embodied knowledge

• I Can Do It: Exploring Voice Assistants for Adults with Intellectual Disabilities

  Madhuka Nadeeshani, Jacqueline Johnstone, Kirsten Ellis, Swamy Ananthanarayan · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper reports an eight-week deployment of screen-based voice assistants (Google Nest Hub and Amazon Echo Show 8) with 17 adults with intellectual disabilities (ID) — including co-occurring autism spectrum disorder, cerebral palsy, Rett syndrome, and partial trisomy…

  voice assistant · intellectual disability · smart display · cognitive accessibility · qualitative research

• Overcoming Speech Barriers: Non-Verbal Voice Cue Interaction Technique for Enhancing Smart Voice Assistant Accessibility for Individuals with Dysarthria

  Aisha Jaddoh, Fernando Loizides, Khadijah Alreafai, Omer Rana · 2025 · ACM Transactions on Accessible Computing

  This study presents DARIA (DysARthrIA), a novel smart voice assistant interaction system that uses non-verbal voice cues instead of spoken words and sentences. The system addresses a critical accessibility gap: commercial voice assistants like Alexa and Google Home rely on…

  dysarthria · speech impairment · voice assistants · smart speakers · non-verbal interaction

• Conversational Voice User Interfaces Supporting Individuals with Down Syndrome: A Literature Review

  Franceli L. Cibrian, Concepción Valdez, Lauren Min, Vivian Genaro Motti · 2025 · ACM Transactions on Accessible Computing

  This systematic literature review examines 43 papers published between 1998 and 2023 on the use of Conversational Voice User Interfaces (CVUIs) to support individuals with Down syndrome. Using the PRISMA methodology, the authors searched ACM Digital Library, IEEE Xplore, PubMed,…

  voice user interfaces · Down syndrome · speech recognition · intellectual disability · conversational AI

• Self-supervised learning using unlabeled speech with multiple types of speech disorder for disordered speech recognition

  Ryoichi Takashima, Takeru Otani, Ryo Aihara, Tetsuya Takiguchi, Shinya Taguchi · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2024)

  This paper tackles a critical barrier in accessible speech technology: automatic speech recognition (ASR) systems perform poorly for people with speech disorders because they are trained almost exclusively on typical speech. The authors from Kobe University and Mitsubishi…

  speech recognition · speech disorders · machine learning · self-supervised learning · assistive technology

• "I stepped into a puddle": Non-Visual Texting in Nomadic Contexts

  Pegah Karimi, Erin Brady, Aqueasha Martin-Hammond, Davide Bolchini · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study investigates the under-explored practice of texting by people who are blind and visually impaired (BVI) while navigating outdoors — what the authors term "nomadic contexts." While previous research has examined accessible text entry methods (screen readers, speech…

  blind and low vision · text entry · mobile accessibility · navigation · assistive technology

• From User Perceptions to Technical Improvement: Enabling People Who Stutter to Better Use Speech Recognition

  Colin Lea, Zifang Huang, Jaya Narain, Lauren Tooley, Dianna Yee, Dung Tien Tran, Panayiotis Georgiou, Jeffrey P. Bigham, Leah Findlater · 2023 · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23)

  This paper investigates how people who stutter (PWS) experience consumer speech recognition systems and demonstrates technical improvements that can significantly reduce errors. The work combines user research with engineering interventions across the speech recognition…

  stuttering · speech recognition · voice assistants · dictation · speech accessibility

• Exploring Smart Speaker User Experience for People Who Stammer

  Anna Bleakley, Daniel Rough, Abi Roper, Stephen Lindsay, Martin Porcheron, Minha Lee, Stuart Alan Nicholson, Benjamin R. Cowan, Leigh Clark · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper investigates how people who stammer experience smart speakers in their daily lives over a three-week period. The researchers deployed Google Nest devices in the homes of 11 participants (mean age 33, recruited through the STAMMA charity in the UK) and collected data…

  stammering · stuttering · speech disfluency · smart speakers · voice interface

• Automatically Generating and Improving Voice Command Interface from Operation Sequences on Smartphones

  Lihang Pan, Chun Yu, JiaHui Li, Tian Huang, Xiaojun Bi, Yuanchun Shi · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

  This paper presents AutoVCI, a system that automatically generates voice command interfaces (VCIs) for smartphone tasks from recorded touch operation sequences, enabling hands-free and eyes-free interaction without requiring programming expertise, corpora, or hand-written rules.…

  voice command interface · mobile accessibility · speech recognition · natural language understanding · programming by demonstration

• INC-Hg: An Intelligent Collaborative Haptic-Gripper Virtual Reality System for Children with Autism to Develop Social Skills

  Yao Zhao, Nicole Shay, Jonathan Cofino, Debra Sterling, Erin Paquette, Adriana Debarros, Maria Gillen, Michelle Won, Zhigang Zhu, Cecilia Feeley, Amy Hurst · 2022 · ACM Transactions on Accessible Computing

  This paper presents INC-Hg (Intelligent Collaborative Haptic-Gripper), a VR system designed to help children with autism spectrum disorder (ASD) practice collaborative and social communication skills. The system addresses a significant challenge: traditional collaborative VR…

  autism spectrum disorder · virtual reality · collaborative learning · haptic feedback · intelligent agents

• Career Interview Readiness in Virtual Reality (CIRVR): A Platform for Simulated Interview Training for Autistic Individuals and Their Employers

  Deeksha Adiani, Aaron Itzkovitz, Dayi Bian, Harrison Katz, Michael Breen, Spencer Hunt, Amy Swanson, Timothy J. Vogus, Joshua Wade, Nilanjan Sarkar · 2022 · ACM Transactions on Accessible Computing

  This paper presents CIRVR (Career Interview Readiness in Virtual Reality), a closed-loop adaptive VR platform designed to help autistic individuals practice job interview skills. The system addresses a critical employment barrier: only 10-50% of autistic adults are employed,…

  autism spectrum disorder · virtual reality · employment · job interviews · stress detection

• Toward Fairness in AI for People with Disabilities: A Research Roadmap

  Anhong Guo, Ece Kamar, Jennifer Wortman Vaughan, Hanna Wallach, Meredith Ringel Morris · 2020 · SIGACCESS Accessibility and Computing

  This position paper from Microsoft Research presents a systematic risk assessment of how major categories of AI systems may fail or discriminate against people with disabilities, proposing a four-point research roadmap for increasing AI fairness. The authors organize their…

  AI fairness · algorithmic bias · disability · computer vision · speech recognition

• Supporting Older Adults in Locating Mobile Interface Features with Voice Input

  Ja Eun Yu, Debaleena Chattopadhyay · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This demonstration paper presents a voice assistant system built on Android that helps older adults locate specific features on complex mobile interfaces by speaking natural language queries. The system addresses a well-documented challenge: older adults struggle to find…

  aging · mobile accessibility · voice interface · user interface design · assistive technology

• Reviewing Speech Input with Audio: Differences between Blind and Sighted Users

  Jonggi Hong, Christine Vaing, Hernisa Kacorri, Leah Findlater · 2020 · ACM Transactions on Accessible Computing

  This paper investigates how blind users identify automatic speech recognition (ASR) errors when reviewing dictated text through audio only—a critical yet understudied aspect of speech-based text entry. While speech input is a primary interaction method for blind mobile users…

  speech recognition · ASR errors · screen readers · text entry · blind users

• Making Emergency Calls More Accessible to Older Adults Through a Hands-free Speech Interface in the House

  Michel Vacher, Frédéric Aman, Solange Rossato, François Portet, Benjamin Lecouteux · 2019 · ACM Transactions on Accessible Computing (TACCESS)

  This paper presents CirdoX, a hands-free voice user interface system designed to detect emergency calls for help from older adults living alone at home. Wearable personal emergency response (PER) systems — typically pendant buttons worn on the neck or wrist — are the mainstream…

  speech recognition · aging · emergency response · ambient assisted living · smart home

• Pushpak: Voice Command-based eBook Navigator

  Shradha Holani, Akashdeep Bansal, M Balakrishnan · 2019 · Proceedings of the 16th International Web for All Conference (W4A)

  This demonstration paper presents Pushpak, a voice command-based eBook navigator designed to reduce the steep learning curve associated with screen reader software. The authors identify a key accessibility barrier: effective use of screen readers like NVDA and JAWS requires…

  voice control · screen reader · NVDA · eBook · natural language understanding

• Handsfree for Web: A Google Chrome extension to browse the web via voice commands

  Javier Pérez · 2019 · Proceedings of the 16th International Web for All Conference (W4A)

  This demonstration paper presents Handsfree for Web, a free Google Chrome browser extension that enables users to browse the web entirely through voice commands. The tool addresses a fundamental accessibility barrier: nearly all websites require manual interaction via keyboard,…

  voice control · speech recognition · motor disability · browser extension · web accessibility

• Automatic Generation and Evaluation of Usable and Secure Audio reCAPTCHA

  Mohit Jain, Rohun Tripathi, Ishita Bhansali, Pratyush Kumar · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper presents reCAPGen, a system that automatically generates usable and secure audio CAPTCHAs by leveraging the gap between human and machine speech recognition abilities. Visual CAPTCHAs — the dominant form of online human verification — are inherently inaccessible to…

  CAPTCHA · audio accessibility · blind · visual impairment · web accessibility

• Exploration of Automatic Speech Recognition for Deaf and Hard of Hearing Students in Higher Education Classes

  Janine Butler, Brian Trager, Byron Behm · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper presents a qualitative study of how deaf and hard of hearing (DHH) students at the National Technical Institute for the Deaf (Rochester Institute of Technology) experienced automatic speech recognition (ASR) as a supplemental access service in mainstream higher…

  speech recognition · Deaf and hard of hearing · captioning · higher education · real-time captions

• ScratchThat: Supporting Command-Agnostic Speech Repair in Voice-Driven Assistants

  Jason Wu, Karan Ahuja, Richard Li, Victor Chen, Jeffrey Bigham · 2019 · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

  This paper presents ScratchThat, a command-agnostic speech repair system for voice-driven virtual assistants that allows users to naturally correct voice commands without repeating entire queries. Current voice assistants like Alexa, Google Assistant, and Siri lack natural…

  voice interface · speech recognition · conversational agents · error correction · natural language processing

• Vocal Programming for People with Upper-Body Motor Impairments

  Lucas Rosenblatt, Patrick Carrington, Kotaro Hara, Jeffrey P. Bigham · 2018 · Proceedings of the 15th International Web for All Conference (W4A 2018)

  This paper presents VocalIDE, a prototype voice-based integrated development environment (IDE) designed to enable people with upper-body motor impairments to write and edit computer code using speech commands rather than a keyboard. Only 4% of professional programmers have…

  speech recognition · motor impairment · cerebral palsy · spinal cord injury · programming education

• Assessing Virtual Assistant Capabilities with Italian Dysarthric Speech

  Fabio Ballati, Fulvio Corno, Luigi De Russis · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18)

  This paper evaluates how well three major smartphone virtual assistants — Apple's Siri, Google Assistant, and Microsoft's Cortana — can understand and respond to Italian dysarthric speech. Dysarthria is a motor speech disorder characterized by slurred, slow, or…

  speech recognition · dysarthria · virtual assistant · voice interface · ALS

• Autonomous Selection and Printing of 3D Models for People Who Are Blind

  Timo Götzelmann · 2018 · ACM Transactions on Accessible Computing

  This paper addresses a significant autonomy gap: while 3D printed models are increasingly used in schools for blind students to understand spatial concepts through touch, the process of finding and printing these models has required sighted assistance. People who are blind could…

  blindness · visual impairment · 3D printing · tactile graphics · voice control

• Personal Perspectives on Using Automatic Speech Recognition to Facilitate Communication between Deaf Students and Hearing Customers

  James R. Mallory, Michael Stinson, Lisa Elliot, Donna Easton · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This experience report examines the use of Automatic Speech Recognition (ASR) via the WhatsApp smartphone app to facilitate communication between deaf and hard-of-hearing (D/HH) students and hearing business customers in real workplace settings. The study took place at the…

  automatic speech recognition · deaf and hard of hearing · workplace accessibility · deaf education · speech recognition