Reviews

Search results

• Fuzzy Feelings: Arousal's Interpretive Noise and the Case for Acoustic-Based Haptics

  Caluã de Lacerda Pataca, Stephanie Patterson, Roshan L Peiris, Matt Huenerfauth · 2026 · CHI '26: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems

  This CHI 2026 paper from a team at Rochester Institute of Technology and Birmingham City University tackles a persistent gap in captioning: traditional captions carry words but strip the emotional tone, rhythm, and vocal affect that sighted hearing viewers absorb automatically.…

  captioning · expressive captions · haptic feedback · vibrotactile · affective computing

• Toward Enhancing Subtitle Features in Mobile Apps: Analyzing User Reviews for Accessibility and Usability Insights

  Wajdi M Aljedaani, Matheus Souza, Marcelo Medeiros Eler · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This large-scale study analyses user reviews from the Google Play Store to understand how people experience subtitle and caption features in mobile applications. The authors extracted roughly 180 million reviews from the top 340 Android apps across diverse categories, then…

  subtitles · captioning · mobile applications · user reviews · app store analysis

• Like, Comment & Caption: A Decade of Social Media Video Caption Research (2015-2025)

  Huong Nguyen, Emma J. McDonnell, Lloyd May, Alexander Druzenko, Zoobia Saifullah Syeda, Mark Cartwright, Sooyeon Lee · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper is a systematic literature review of 36 peer-reviewed studies on Social Media Video Captions (SMVC) published between 2015 and 2025, spanning HCI, accessibility, media studies, education, and language learning. The authors use 'SMVC' as an umbrella for…

  captioning · captions · video accessibility · social media accessibility · Deaf and hard of hearing

• Redesigning Educational Videos for Deaf and Hard-of-Hearing Learners

  Si Chen, Haocong Cheng, Suzy Su, Lu Ming, Sarah Masud, Qi Wang, Yun Huang · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Educational videos have exploded in higher education and online learning, but accessibility guidance for d/Deaf and Hard-of-Hearing (DHH) learners has barely moved beyond captions and transcripts. Chen and colleagues argue this is a theoretical gap as much as a practical one:…

  deaf and hard of hearing · video accessibility · captioning · multimedia learning · cognitive accessibility

• Silence is a Feature, Not a Bug: A Deaf Developer’s Autoethnography on Agency and Local AI

  Chenyang Gong · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA ’26)

  This CHI 2026 Extended Abstract is a three-page autoethnographic provocation by a Deaf computer science graduate student who uses a MED-EL cochlear implant. The author refuses the medical-model framing of deafness as deficit and instead argues that the ability to remove the…

  autoethnography · deaf and hard of hearing · cochlear implant · automatic speech recognition · captioning

• Speaker-Aware Affective Captioning for Multi-Speaker STEM Talk in Inclusive Classrooms

  Sunday David Ubur, Denis Gracanin, Stephanie P DeHart, Enoch Katey Akli, Fatemeh Sarshartehrani, Sikiru Adewale · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26)

  Ubur and colleagues at Virginia Tech address a specific failure mode of live captioning in classroom and meeting settings: collapsing multi-speaker discourse into a single text stream that obscures who said what and how it was said. They argue this is especially consequential…

  captioning · deaf and hard of hearing · speaker diarization · speech emotion recognition · STEM education

• CuCap: Comparative Analysis of Customized Captioning between North American and South Korean d/Deaf and Hard-of-Hearing Users

  Caluã de Lacerda Pataca, SooYeon Ahn, Suhyeon Yoo, JooYeong Kim, Khai N. Truong, Jin-Hyuk Hong, Roshan L Peiris, Matt Huenerfauth · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces CuCap, a customizable captioning system that allows d/Deaf and Hard-of-Hearing (DHH) users to personalize how paralinguistic speech features are visually represented in captions. Traditional captions convey only the words spoken, losing important…

  deaf and hard of hearing · captioning · customization · cross-cultural study · speech prosody

• Notification Designs for Influencing Hearing Speakers' Behaviors During Captioned Conversations Among Mixed DHH-Hearing Groups

  Matthew Seita, Sarah Andrew, Matt Huenerfauth · 2025 · Proceedings of the 22nd International Web for All Conference (W4A 2025)

  This paper investigates notification system designs that prompt hearing speakers to adjust their speech behaviors (speaking slower, louder, or more clearly) during ASR-captioned videoconference conversations with Deaf and Hard of Hearing (DHH) participants. The researchers…

  deaf and hard of hearing · automatic speech recognition · captioning · notification design · videoconferencing

• Barriers to Employment: The Deaf Multimedia Authoring Tax

  Christian Vogler, Abraham Glasser, Raja Kushalnagar, Matthew Seita, Mariana Arroyo Chavez, Keith Delk, Paige DeVries, Molly Feanny, Bernard Thompson, James Waller · 2025 · Proceedings of the 22nd International Web for All Conference (W4A)

  This paper from Gallaudet University describes through firsthand experience the enormous additional burden — termed the "deaf multimedia authoring tax" — that deaf and hard of hearing (DHH) people face when creating accessible multimedia content for the workplace. Written by a…

  deaf and hard of hearing · sign language · content creation · workplace accessibility · captioning

• Envisioning Collective Communication Access: A Theoretically-Grounded Review of Captioning Literature from 2013-2023

  Emma J. McDonnell, Leah Findlater · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '24)

  This paper synthesises thinking from four fields — disability studies, Deaf studies, disability justice, and communication studies — into a framework of collective communication access, then uses it to analyse a decade of HCI captioning research (2013–2023). The authors argue…

  captioning · deaf and hard of hearing · collective access · disability justice · disability studies

• Accessible Gaming Through Better Captions: A Study on Captions Preferences and Inclusivity of Deaf and Hard-of-Hearing Players

  Wajdi Aljedaani, Marcelo M. Eler, Lorene E Keeland, Hamed Jalali, Khaled Al-Raddah, Mohamed Wiem Mkaouer · 2024 · Proceedings of the 21st International Web for All Conference (W4A '24)

  This study surveys 73 deaf and hard-of-hearing (d/Deaf) individuals about their preferences for caption design in video games, addressing a significant gap: while captioning standards exist for television and film, there are no universally accepted standards for video game…

  deaf accessibility · captioning · game accessibility · video games · user preferences

• "Signifier" Video Sharing Platform and Accessible Media Player for Deaf Users

  Paraskevi Panagi, Alexandros Yeratziotis, Thomas Fotiadis, Christos Mettouris, George Angelos Papadopoulos · 2024 · Proceedings of the 2024 International Conference on Information Technology for Social Good (GoodIT)

  This paper from the University of Cyprus and Connect Deaf presents the "Signifier" video sharing platform and its integrated Signifier Accessible Media Player (SiAMP), designed specifically to address the lack of accessible video media for Deaf and Hard-of-Hearing (D & HH)…

  deaf accessibility · sign language · media accessibility · video accessibility · inclusive design

• Caption Royale: Exploring the Design Space of Affective Captions from the Perspective of Deaf and Hard-of-Hearing Individuals

  Caluã de Lacerda Pataca, Saad Hassan, Nathan Tinker, Roshan Lalintha Peiris, Matt Huenerfauth · 2024 · CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

  This CHI 2024 paper from Rochester Institute of Technology and Tulane tackles a concrete design question: if we want captions to convey a speaker's emotion — not just their words — which typographic modulations should we use? Prior work had established that affective captions…

  captioning · affective captions · expressive captions · typography · valence

• Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study investigates how Deaf and Hard of Hearing (DHH) viewers distribute their visual attention across different information regions on screen while watching captioned live television news. More than 360 million people worldwide are DHH, and many rely on captions to access…

  deaf and hard of hearing · captioning · eye tracking · television accessibility · caption placement

• Who is speaking: Unpacking In-text Speaker Identification Preference of Viewers who are Deaf and Hard of Hearing while Watching Live Captioned Television Program

  Akhter Al Amin, Joseph Mendis, Raja Kushalnagar, Christian Vogler, Matt Huenerfauth · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study systematically investigates how the number of speakers onscreen in live television programs affects Deaf and Hard of Hearing (DHH) viewers' preferences for different in-text speaker identification methods in captions. Live TV news and interviews often feature multiple…

  deaf and hard of hearing · captioning · live captioning · television accessibility · caption quality

• Jod: Examining Design and Implementation of a Videoconferencing Platform for Mixed Hearing Groups

  Mittal, Anant, Gupta, Meghna, Poddar, Roshni, Naik, Tarini, Kuppuraj, Seethalakshmi, Fogarty, James, Kumar, Pratyush, Jain, Mohit · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents the design, implementation, and evaluation of Jod (a Hindi word meaning "link"), a web-based videoconferencing platform purpose-built for mixed hearing group communication. Current platforms like Zoom, Teams, and Google Meet present significant accessibility…

  deaf and hard of hearing · videoconferencing · sign language · mixed hearing groups · visual layout

• Enhancing Non-Speech Information Communicated in Closed Captioning Through Critical Design

  May, Lloyd, Park, So Yeon, Berger, Jonathan · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper investigates the communication of non-speech information (NSI) in closed captioning for d/Deaf and hard of hearing (DHH) viewers through a mixed-methods study combining needfinding interviews, prototype development, surveys, and evaluation interviews with 20 DHH…

  captioning · non-speech information · deaf and hard of hearing · critical design · sound communication

• Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing Users

  Caluã de Lacerda Pataca, Matthew Watkins, Roshan Peiris, Sooyeon Lee, Matt Huenerfauth · 2023 · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23)

  This CHI 2023 paper tackles a dimension of captioning that has gone largely unaddressed for four decades: captions depict words but strip out the prosody and emotion carried by a speaker's voice. The authors argue that while automatic speech recognition (ASR) has reduced word…

  captioning · deaf and hard of hearing · prosody · affective computing · videoconferencing accessibility

• Access on Demand: Real-time, Multi-modal Accessibility for the Deaf and Hard-of-Hearing based on Augmented Reality

  Roshan Mathew, Brian Mak, Wendy Dannels · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This experience report documents two deaf researchers' hands-on evaluation of Access on Demand (AoD), an augmented reality application developed at Rochester Institute of Technology that delivers real-time captioning and American Sign Language (ASL) interpretation through Vuzix…

  augmented reality · deaf and hard of hearing · smart glasses · captioning · sign language interpretation

• Understanding Social and Environmental Factors to Enable Collective Access Approaches to the Design of Captioning Technology

  Emma McDonnell · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This doctoral consortium paper presents a dissertation research program that reimagines how captioning technology should be designed by applying the disability justice principle of collective access — the idea that accessibility is a shared responsibility of all group members,…

  captioning · collective access · disability justice · deaf and hard of hearing · co-design

• Beyond Subtitles: Captioning and Visualizing Non-speech Sounds to Improve Accessibility of User-Generated Videos

  Oliver Alonzo, Hijung Valentina Shin, Dingzeyu Li · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper investigates a significant gap in video captioning: the representation of non-speech sounds. While automatic speech recognition (ASR) has become widely available for generating captions on platforms like YouTube, TikTok, and Zoom, these systems focus exclusively on…

  deaf and hard of hearing · captioning · non-speech sounds · automatic captions · video accessibility

• Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing Pairs

  Matthew Seita, Sooyeon Lee, Sarah Andrew, Kristen Shinohara, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper addresses two intertwined problems. First, methodologically, how can co-design research involving both Deaf/Hard-of-Hearing (DHH) and hearing participants be conducted remotely during and beyond COVID-19, when in-person sessions are not possible and masks…

  automatic speech recognition · deaf and hard of hearing · participatory design · co-design · videoconferencing

• Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly transcribed captions become…

  captioning · captions · caption occlusion · deaf and hard of hearing · television accessibility

• Effect of Caption Width on the TV User Experience by Deaf and Hard of Hearing Viewers

  Abraham Glasser, Joseline Garcia, Chang Hwang, Christian Vogler, Raja Kushalnagar · 2021 · Proceedings of the 18th International Web for All Conference (W4A)

  This study from Rochester Institute of Technology and Gallaudet University investigates how caption line width affects the viewing experience for Deaf and hard of hearing (DHH) viewers. Captioning technology has not kept pace with the shift from broadcast TV to diverse personal…

  captioning · deaf and hard of hearing · video accessibility · user experience · media accessibility

• Deaf and Hard-of-hearing Users Evaluating Designs for Highlighting Key Words in Educational Lecture Videos

  Sushant Kafle, Becca Dingman, Matt Huenerfauth · 2021 · ACM Transactions on Accessible Computing

  This empirical study investigates design preferences for keyword highlighting in video captions among Deaf and Hard of Hearing (DHH) users. While style guides like the APA Publication Manual and Chicago Manual of Style provide recommendations for highlighting text in static…

  deaf and hard of hearing · captions · captioning · video accessibility · text highlighting