Reviews

Search results

• μCap: Instrumental Music Captions for Deaf and Hard-of-Hearing Individuals

  SooYeon Ahn, In-Chang Baek, KyungJoong Kim, Khai N. Truong, Jin-Hyuk Hong · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Ahn and colleagues introduce μCap (Music Captions), an automatic captioning system that makes instrumental music accessible to Deaf and Hard-of-Hearing (DHH) audiences by producing time-aligned, non-lexical textual renderings — syllable-like strings such as 'Tta-da-ding' or…

  deaf and hard of hearing · DHH · captions · closed captions · music accessibility

• Like, Comment & Caption: A Decade of Social Media Video Caption Research (2015-2025)

  Huong Nguyen, Emma J. McDonnell, Lloyd May, Alexander Druzenko, Zoobia Saifullah Syeda, Mark Cartwright, Sooyeon Lee · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper is a systematic literature review of 36 peer-reviewed studies on Social Media Video Captions (SMVC) published between 2015 and 2025, spanning HCI, accessibility, media studies, education, and language learning. The authors use 'SMVC' as an umbrella for…

  captioning · captions · video accessibility · social media accessibility · Deaf and hard of hearing

• FAME: Exploring Expressive Facial Avatars for Lyrical and Non-Lyrical Music Visualization for d/Deaf Individuals

  Suhyeon Yoo, Yifang Pan, Ashish Ajin Thomas, Karan Singh, Khai N. Truong · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper investigates whether expressive facial avatars can carry the emotional and structural richness of music — rhythm, pitch, melody, lyrics, and emotion — to d/Deaf and Hard of Hearing (DHH) audiences in ways that captions and abstract visualizers cannot. The…

  Deaf music · DHH · music accessibility · facial avatar · music visualization

• Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing Viewers

  Caluã de Lacerda Pataca, Saad Hassan, Lloyd May, Michelle M Olson, Toni D'aurio, Roshan L Peiris, Matt Huenerfauth · 2025 · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25)

  This paper explores a multimodal approach to affective captioning — captions that convey not just the words a speaker says but the emotional dimensions of their voice — for d/Deaf and Hard-of-Hearing (dhh) viewers. Prior work has shown that typographic modulations such as…

  affective captioning · haptics · deaf and hard of hearing · multimodal interaction · captions

• Measuring the Accuracy of Automatic Speech Recognition Solutions

  Korbinian Kuhn, Verena Kersken, Benedikt Reuter, Niklas Egger, Gottfried Zimmermann · 2024 · ACM Transactions on Accessible Computing

  This study provides independent, comprehensive benchmarking of 11 common automatic speech recognition (ASR) services to assess their real-world accuracy for accessibility purposes. The research addresses a critical gap: while vendors claim "state-of-the-art accuracy" and…

  automatic speech recognition · ASR · captions · deaf and hard of hearing · transcription

• Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing Pairs

  Matthew Seita, Sooyeon Lee, Sarah Andrew, Kristen Shinohara, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper addresses two intertwined problems. First, methodologically, how can co-design research involving both Deaf/Hard-of-Hearing (DHH) and hearing participants be conducted remotely during and beyond COVID-19, when in-person sessions are not possible and masks…

  automatic speech recognition · deaf and hard of hearing · participatory design · co-design · videoconferencing

• Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly transcribed captions become…

  captioning · captions · caption occlusion · deaf and hard of hearing · television accessibility

• Caption-Occlusion Severity Judgments across Live-Television Genres from Deaf and Hard-of-Hearing Viewers

  Akhter Al Amin, Saad Hassan, Matt Huenerfauth · 2021 · Proceedings of the 18th International Web for All Conference (W4A '21)

  This paper addresses a largely overlooked dimension of caption quality for Deaf and Hard of Hearing (DHH) viewers: the problem of captions occluding important onscreen visual content during live television broadcasts. While existing caption quality metrics focus primarily on…

  deaf and hard of hearing · captions · television accessibility · caption placement · media accessibility

• I See What You're Saying: A Literature Review of Eye Tracking Research in Communication of Deaf or Hard of Hearing Users

  Chanchal Agrawal, Roshan L Peiris · 2021 · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21)

  This paper presents a comprehensive literature review of 55 eye-tracking studies examining the gaze patterns and communication behaviours of deaf or hard-of-hearing (DHH) individuals. The authors systematically searched ACM, IEEE, Google Scholar, and linguistics and psychology…

  deaf and hard of hearing · eye tracking · eye gaze · sign language · lip-reading

• Deaf and Hard-of-hearing Users Evaluating Designs for Highlighting Key Words in Educational Lecture Videos

  Sushant Kafle, Becca Dingman, Matt Huenerfauth · 2021 · ACM Transactions on Accessible Computing

  This empirical study investigates design preferences for keyword highlighting in video captions among Deaf and Hard of Hearing (DHH) users. While style guides like the APA Publication Manual and Chicago Manual of Style provide recommendations for highlighting text in static…

  deaf and hard of hearing · captions · captioning · video accessibility · text highlighting

• Teleconference Accessibility and Guidelines for Deaf and Hard of Hearing Users

  Raja S. Kushalnagar, Christian Vogler · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This experience report from two Gallaudet University researchers examines the accessibility challenges that deaf and hard of hearing (DHH) users face in teleconference environments, drawing on nearly a decade of first-hand participation across platforms including Zoom, Microsoft…

  deaf · hard of hearing · teleconferencing · remote participation · sign language

• Deaf Individuals' Views on Speaking Behaviors of Hearing Peers when Using an Automatic Captioning App

  Matthew Seita, Matt Huenerfauth · 2020 · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20)

  This CHI 2020 Late-Breaking Work paper investigates what behaviors hearing speakers should ideally exhibit when holding in-person conversations with Deaf or deaf people using an Automatic Speech Recognition (ASR) captioning app on a mobile device. The authors position the study…

  automatic speech recognition · deaf and hard of hearing · captioning · captions · speaking behavior

• Usability Evaluation of Captions for People Who Are Deaf or Hard of Hearing

  Sushant Kafle, Matt Huenerfauth · 2018 · SIGACCESS Accessibility and Computing Newsletter (Issue 122)

  This is a SIGACCESS Newsletter article summarizing a line of research by Kafle and Huenerfauth on building a caption-quality evaluation metric that actually reflects the experience of Deaf and Hard-of-Hearing (DHH) readers — rather than simply counting speech-recognition errors.…

  automatic speech recognition · captioning · captions · caption quality · accessibility metrics

• Accessible OzPlayer Video Player

  Matt McLeod, Gian Wild · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

  This extended abstract presents OzPlayer, a web video player built by Australian accessibility consultancy AccessibilityOz specifically to address the widespread inaccessibility of popular video players on the web. The authors, who routinely audited client websites, found that…

  video accessibility · media accessibility · keyboard accessibility · captions · audio description

• HTML5 accessible video player: how and why

  Crista Earl, Elizabeth Neal · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

  This paper from the American Foundation for the Blind (AFB) describes the development of a free, open source HTML5 video player designed to address the widespread accessibility barriers in online video playback interfaces. The authors identify four key problems with existing…

  video accessibility · media accessibility · HTML5 · keyboard accessibility · low vision

• Responsive Design for Personalised Subtitles

  Chris J. Hughes, Mike Armstrong, Rhianne Jones, Michael Crabb · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

  This paper from BBC R&D and the University of Dundee proposes applying responsive web design principles to subtitle display, moving away from the legacy Teletext format that has constrained subtitling since 1979. Traditional subtitles are pre-blocked into fixed 38-character-wide…

  subtitles · captions · responsive design · video accessibility · personalization

• Online News Videos: The UX of Subtitle Position

  Michael Crabb, Rhianne Jones, Mike Armstrong, Chris J. Hughes · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This BBC-funded research investigates whether repositioning subtitles from their traditional placement within a video to below the video frame improves user experience for online news content. The study addresses a gap in captioning research: while television subtitling has…

  subtitles · captions · deaf accessibility · user experience · video accessibility

• Evaluating Alternatives for Better Deaf Accessibility to Selected Web-Based Multimedia

  Brent N. Shiver, Rosalee J. Wolfe · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This research addresses the accessibility gap created by the proliferation of uncaptioned video content online—a particular problem for deaf adults who use American Sign Language as their primary language and view English as a second language. While television captioning has…

  deaf accessibility · captions · automatic speech recognition · ASR · multimedia accessibility

• AVD-LV: An Accessible Player for Captioned STEM Videos

  Raja S. Kushalnagar, John J. Rivera, Warrance Yu, Daniel S. Steed · 2014 · ASSETS '14: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility

  This demo paper presents AVD-LV (Accessible View Device interface for Low Vision), a Chrome browser extension that enhances YouTube lecture video accessibility for deaf and low vision (DLV) viewers. The core problem is that captioned videos require DLV viewers to process two…

  deaf · low vision · captions · video accessibility · STEM education

• E-learning 2.0: You Are We-LCoME!

  Stefano Ferretti, Silvia Mirri, Ludovico Antonio Muratori, Marco Roccetti, Paola Salomoni · 2008 · Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper presents We-LCoME (Wiki e-Learning Compound Multimedia Environment), a collaborative platform for creating and enriching accessible multimedia e-learning resources. Built on top of DokuWiki, the system allows a community of "prosumers" — lecturers, students, learning…

  e-learning · multimedia accessibility · collaborative authoring · Web 2.0 · SMIL

20 results.