Reviews

Search results

• LaboSignes: an Interactive French Sign Language Recognition Interface

  Jules Françoise, Julie Lascar, Cyril Verrechia, Sidonie Minodier, Michèle Gouiffès, Annelies Braffort · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA ’26)

  LaboSignes is a web-based interactive French Sign Language (LSF) recognition system aimed at search-by-sign, addressing the fact that most online resources, including bilingual dictionaries and news sites, are navigable only through written French, which is a second language for…

  sign language · French Sign Language · sign language recognition · Deaf accessibility · gesture recognition

• Exploring Collaboration to Center the Deaf Community in Sign Language AI

  Rie Kamikubo, Abraham Glasser, Alex X Lu, Hal Daumé III, Hernisa Kacorri, Danielle Bragg · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper investigates the critical disconnect between machine learning (ML) practitioners and Deaf American Sign Language (ASL) signers in the development of sign language AI technologies. Despite sign language processing's promise for societal inclusivity, the field…

  Deaf community · sign language · American Sign Language · machine learning · participatory AI

• Joint Bilingual Navigation of Informed Consent and Intake Forms in American Sign Language and Written English

  Matthew Seita, Michaela Usha, Rachel Skwersky, Poorna Kushalnagar, Raja Kushalnagar · 2025 · Proceedings of the 22nd International Web for All Conference (W4A 2025)

  This paper presents a joint bilingual informed consent and intake form that can be navigated simultaneously in American Sign Language (ASL) and written English, addressing a critical accessibility barrier for the approximately 500,000 Americans who primarily use ASL. Current…

  deaf and hard of hearing · sign language recognition · informed consent · healthcare accessibility · American Sign Language

• Towards an AI-Driven Video-Based American Sign Language Dictionary: Exploring Design and Usage Experience with Learners

  Saad Hassan, Matyas Bohacek, Chaelin Kim, Denise Crochet · 2025 · Proceedings of the 22nd International Web for All Conference (W4A)

  This paper presents the design, implementation, and user evaluation of a fully automated video-based American Sign Language (ASL) dictionary that allows learners to look up unfamiliar signs by recording themselves performing the sign via webcam. Unlike traditional sign language…

  sign language technology · ASL dictionary · sign language recognition · video-based search · language learning

• The Sem-Lex Benchmark: Modeling ASL Signs and their Phonemes

  Lee Kezar, Jesse Thomason, Naomi Caselli, Zed Sehyr, Elana Pontecorvo · 2023 · ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces the Sem-Lex Benchmark, the largest curated dataset of its kind for American Sign Language (ASL) isolated sign recognition, containing over 84,000 videos of isolated sign productions from 41 deaf ASL signers. The dataset addresses two critical barriers in…

  sign language recognition · American Sign Language · machine learning · phonology · dataset

• A Systematic Review of User Studies as a Basis for the Design of Systems for Automatic Sign Language Processing

  Soraia Prietch, J. Alfredo Sánchez, Josefina Guerrero · 2022 · ACM Transactions on Accessible Computing

  This systematic literature review examines how user studies have been conducted in the design of Automatic Sign Language Processing (ASLP) systems. The authors searched seven repositories plus Google Scholar, identifying 2,486 papers and ultimately selecting 37 primary studies…

  sign language · automatic sign language processing · user studies · participatory design · Deaf community

• Analyzing Deaf and Hard-of-Hearing Users' Behavior, Usage, and Interaction with a Personal Assistant Device that Understands Sign-Language Input

  Abraham Glasser, Matthew Watkins, Kira Hart, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper investigates how Deaf and Hard-of-Hearing (DHH) ASL signers would actually use a personal assistant device (such as an Amazon Echo Show or Google Home) if it could understand American Sign Language commands. The authors position their work against the…

  sign language · american sign language · deaf and hard of hearing · personal assistants · voice assistants

• Design and Evaluation of Hybrid Search for American Sign Language to English Dictionaries: Making the Most of Imperfect Sign Recognition

  Saad Hassan, Akhter Al Amin, Alexis Gordon, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper tackles a practical problem faced by the roughly 200,000 students currently studying American Sign Language (ASL) in the US: how do you look up the meaning of a sign you just saw when you don't know its English gloss? Unlike written languages, ASL has no…

  american sign language · sign language · sign language recognition · search interfaces · dictionary

• Understanding Deaf and Hard-of-Hearing Users' Interest in Sign-Language Interaction with Personal-Assistant Devices

  Abraham Glasser, Vaishnavi Mande, Matt Huenerfauth · 2021 · Proceedings of the 18th International Web for All Conference (W4A '21)

  This mixed-methods study investigates Deaf and Hard of Hearing (DHH) users' experiences with and interest in personal-assistant devices (such as Amazon Alexa and Google Home) that could understand American Sign Language (ASL) commands. The research was motivated by the growing…

  deaf and hard of hearing · sign language · personal assistants · voice interface · smart home

• The FATE Landscape of Sign Language AI Datasets: An Interdisciplinary Perspective

  Danielle Bragg, Oscar Koller, Mary Bellard, Larwan Berke, Patrick Boudreault, Annelies Braffort, Naomi Caselli, Matt Huenerfauth, Hernisa Kacorri, Tessa Verhoef, Christian Vogler, Meredith Ringel Morris · 2021 · ACM Transactions on Accessible Computing

  This interdisciplinary paper examines the ethical landscape of AI datasets used for sign language recognition, generation, and translation technologies. Drawing on expertise from deaf community members, sign language linguists, and AI researchers, the authors apply the FATE…

  sign language · AI datasets · deaf community · FATE framework · machine learning

• Effect of Sign-recognition Performance on the Usability of Sign-language Dictionary Search

  Saad Hassan, Oliver Alonzo, Abraham Glasser, Matt Huenerfauth · 2021 · ACM Transactions on Accessible Computing

  This paper investigates how the performance of sign-language recognition technology affects user satisfaction with ASL dictionary search systems. Unlike written languages where users can type unfamiliar words to look them up, ASL learners who encounter an unfamiliar sign cannot…

  American Sign Language · ASL · sign language recognition · dictionary search · information retrieval

• Exploring Collection of Sign Language Datasets: Privacy, Participation, and Model Performance

  Danielle Bragg, Oscar Koller, Naomi Caselli, William Thies · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This paper tackles a fundamental tension in building machine learning systems for marginalized communities: the need for large training datasets versus the privacy risks of collecting data from small, identifiable populations. The authors focus on sign language video collection,…

  sign language · privacy · machine learning · data collection · Deaf culture

• A Portable Hong Kong Sign Language Translation Platform with Deep Learning and Jetson Nano

  Zhenxing Zhou, Yisiang Neo, King-Shan Lui, Vincent W.L. Tam, Edmund Y. Lam, Ngai Wong · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This demonstration paper presents a portable platform for translating Hong Kong Sign Language (HKSL) into spoken language using deep learning and edge computing hardware. The system addresses a significant communication gap: Hong Kong has over 155,000 deaf or hard of hearing…

  sign language recognition · deep learning · edge computing · mobile accessibility · deaf and hard of hearing

• Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective

  Danielle Bragg, Oscar Koller, Mary Bellard, Larwan Berke, Patrick Boudreault, Annelies Braffort, Naomi Caselli, Matt Huenerfauth, Hernisa Kacorri, Tessa Verhoef, Christian Vogler, Meredith Ringel Morris · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper provides a comprehensive interdisciplinary overview of sign language processing — encompassing recognition, generation, and translation — produced through a two-day workshop bringing together 39 experts from computer science, linguistics, Deaf studies, and industry.…

  sign language · Deaf culture · computer vision · natural language processing · machine translation

• Effect of Automatic Sign Recognition Performance on the Usability of Video-Based Search Interfaces for Sign Language Dictionaries

  Oliver Alonzo, Abraham Glasser, Matt Huenerfauth · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper investigates how the performance of automatic sign recognition technology affects user satisfaction when searching for unfamiliar words in an ASL-to-English dictionary. Looking up an unknown sign in ASL is fundamentally harder than looking up an unknown written word:…

  sign language · ASL · sign language recognition · dictionary · Deaf and hard of hearing

• Real-Time Depth-Camera Based Hand Tracking for ASL Recognition

  Brandon Taylor, Anind Dey, Daniel Siewiorek, Asim Smailagic · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This demonstration paper validates the use of a publicly available real-time hand tracking algorithm (Sphere-Mesh) for recognizing American Sign Language (ASL) handshapes using a depth camera. Sign Language Recognition (SLR) has long been a motivating goal for high-precision…

  sign language recognition · hand tracking · computer vision · depth camera · machine learning

• Sign Transition Modeling and a Scalable Solution to Continuous Sign Language Recognition for Real-World Applications

  Kehuang Li, Zhengyu Zhou, Chin-Hui Lee · 2016 · ACM Transactions on Accessible Computing

  This paper presents a scalable framework for continuous sign language recognition (SLR) designed to work in real-world conditions using affordable hardware. The researchers address a fundamental challenge in SLR: modeling the transitions between signs. Unlike spoken language…

  sign language recognition · hidden Markov models · machine learning · deaf and hard of hearing · wearable technology

• Isolated Sign Language Recognition with Grassmann Covariance Matrices

  Hanjie Wang, Xiujuan Chai, Xiaopeng Hong, Guoying Zhao, Xilin Chen · 2016 · ACM Transactions on Accessible Computing

  This paper proposes a novel method for isolated sign language recognition using Grassmann Covariance Matrices (GCM) to fuse multimodal features captured by Microsoft Kinect. With 360 million people worldwide affected by hearing loss—21 million in China alone—automatic sign…

  sign language recognition · Chinese sign language · computer vision · machine learning · deaf and hard of hearing

• Brazilian Sign Language Multimedia Hangman Game: A Prototype of an Educational and Inclusive Application

  Renata Cristina Barros Madeo · 2011 · The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This doctoral consortium paper presents a prototype educational game — a hangman game that uses Brazilian Sign Language (BSL/Libras) as its input method. Instead of typing letters on a keyboard, players perform fingerspelling signs from the Libras manual alphabet in front of a…

  sign language · sign language recognition · deaf accessibility · educational technology · game accessibility

• Accurate and Accessible Motion-Capture Glove Calibration for Sign Language Data Collection

  Matt Huenerfauth, Pengfei Lu · 2010 · ACM Transactions on Accessible Computing

  This paper addresses a critical bottleneck in sign language technology research: the calibration of motion-capture gloves used to record hand movements for ASL animation and recognition systems. Motion-capture data enables the development of sign language animations that can…

  sign language · American Sign Language · deaf accessibility · motion capture · animation

• Spatial and Temporal Pyramids for Grammatical Expression Recognition of American Sign Language

  Nicholas Michael, Dimitris Metaxas, Carol Neidle · 2009 · Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09)

  This paper presents a novel computer vision framework for recognizing grammatical facial expressions and head gestures in American Sign Language (ASL) video. While most sign language recognition research has focused on manual components (hand shapes and movements), this work…

  sign language recognition · American Sign Language · non-manual markers · computer vision · facial expression recognition

• American Sign Language Recognition in Game Development for Deaf Children

  Helene Brashear, Valerie Henderson, Kwang-Hyun Park, Harley Hamilton, Seungyon Lee, Thad Starner · 2006 · Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '06)

  This paper presents CopyCat, an educational computer game that uses gesture recognition technology to help young deaf children (ages 6-11) practice American Sign Language (ASL) skills. The project addresses a critical language development challenge: 90% of deaf children are born…

  deaf education · sign language recognition · ASL · gesture recognition · computer vision

• A Gesture Recognition Architecture for Sign Language

  Annelies Braffort · 1996 · Proceedings of the Second Annual ACM Conference on Assistive Technologies (Assets '96)

  This paper from LIMSI-CNRS in France presents a gesture recognition architecture specifically designed for sign languages, grounded in a detailed linguistic analysis of French Sign Language (LSF). The key insight is that sign languages differ fundamentally from oral languages in…

  sign language · gesture recognition · French Sign Language · data glove · sign language recognition

• Pattern recognition and synthesis for sign language translation system

  M. Ohki, H. Sagawa, T. Sakiyama, E. Oohira, H. Ikeda, H. Fujisawa · 1994 · Proceedings of the First Annual ACM Conference on Assistive Technologies (Assets '94)

  This paper describes a bidirectional sign language translation system being developed to translate between Japanese Sign Language (JSL) and written Japanese. The system addresses both directions of translation: recognizing sign language input and converting it to Japanese text,…

  sign language recognition · sign language synthesis · Japanese Sign Language · gesture recognition · DataGlove

24 results.