Reviews

Search results

• GestureVoice: Enabling Multimodal Text Editing for Blind Users Using Gestures and Voice

  Prerna Khanna, Sai Pravallika Reddy, IV Ramakrishnan, Xiaojun Bi, Aruna Balasubramanian · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces GestureVoice, a multimodal text editing system that enables blind smartphone users to edit text using mid-air hand gestures detected by a smartwatch combined with voice commands, eliminating the need for touchscreen interaction. The research addresses a…

  text editing · blind users · multimodal interaction · gesture recognition · voice commands

• All the Way There and Back: Inertial-Based, Phone-in-Pocket Indoor Wayfinding and Backtracking Apps for Blind Travelers

  Chia Hsuan Tsai, Fatemeh Elyasi, Peng Ren, Roberto Manduchi · 2024 · ACM Transactions on Accessible Computing

  This paper presents two iOS apps designed to help blind travelers navigate indoor building environments without requiring external infrastructure like Bluetooth beacons or visual markers. The Wayfinding app uses a known floor plan to compute and guide users along the shortest…

  indoor navigation · wayfinding · blind and low vision · inertial sensors · dead reckoning

• Watch Your Language: Using Smartwatches to Support Communication

  Humphrey Curtis, Timothy Neate · 2023 · ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper presents the first participatory design and evaluation of AAC smartwatch applications co-designed directly with people who have complex communication needs (CCNs), specifically people living with aphasia — an acquired language impairment most commonly caused by stroke…

  augmentative and alternative communication · AAC · smartwatch · aphasia · wearable technology

• A feasibility study on the use of audio-based ecological momentary assessment with persons with aphasia

  Hester, Yolanda, Billah, Syed Masum, Shinohara, Kristen · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents a feasibility study investigating whether audio-based ecological momentary assessment (EMA) can be used to evaluate word-finding difficulties (anomia) in people with aphasia outside clinical settings. Aphasia, a language disorder typically resulting from…

  aphasia · ecological momentary assessment · smartwatch · audio data collection · anomia

• "Not There Yet": Feasibility and Challenges of Mobile Sound Recognition to Support Deaf and Hard-of-Hearing People

  Jeremy Zhengqi Huang, Hriday Chhabria, Dhruv Jain · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents the first longitudinal field study of a mobile sound recognition system used by Deaf and hard of hearing (DHH) people in their daily lives. The researchers deployed SoundWatch, a smartwatch-based app that uses a deep learning model (Google YAMNet…

  deaf and hard of hearing · sound recognition · wearable technology · smartwatch · assistive technology

• Technical Perspective: Computation Where the (Inter)Action Is

  Jeffrey P. Bigham · 2022 · Communications of the ACM

  This one-page technical perspective accompanies the SoundWatch paper in Communications of the ACM. Bigham uses SoundWatch — a smartwatch prototype that detects audio events and displays descriptions for deaf and hard-of-hearing people — as a lens to explore broader questions…

  wearable technology · deaf and hard of hearing · sound recognition · smartwatch · assistive technology

• WLA4ND: a Wearable Dataset of Learning Activities for Young Adults with Neurodiversity to Provide Support in Education

  Hui Zheng, Pattiya Mahapasuthanon, Yujing Chen, Huzefa Rangwala, Anya S Evmenova, Vivian Genaro Motti · 2021 · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21)

  This paper introduces WLA4ND (Wearable Learning Activities for Neurodiversity), the first wearable sensor dataset of learning activities collected from young adults with neurodiversity. While existing wearable sensor datasets focus on fitness, daily living, and locomotion…

  neurodiversity · wearable technology · machine learning · activity recognition · inclusive education

• Activity Recognition in Older Adults with Training Data from Younger Adults: Preliminary Results on in Vivo Smartwatch Sensor Data

  Sabahat Fatima · 2021 · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21)

  This extended abstract investigates a critical age-related bias in wearable activity recognition: models trained on data from younger adults perform significantly worse when applied to older adults. The study is motivated by the growing potential of smartwatch-based…

  older adults · activity recognition · machine learning · wearable technology · smartwatch

• SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users

  Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon Froehlich · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '20)

  This paper presents SoundWatch, a smartwatch-based sound awareness system that uses deep learning to classify environmental sounds in real time and provide visual and haptic notifications to deaf and hard of hearing (DHH) users. The research addresses the finding from prior…

  deaf accessibility · hard of hearing · sound awareness · deep learning · wearable technology

• Designing and Evaluating a Customizable Head-mounted Vision Enhancement System for People with Low Vision

  Yuhang Zhao, Sarit Szpiro, Lei Shi, Shiri Azenkot · 2019 · ACM Transactions on Accessible Computing (TACCESS)

  This paper presents ForeSee, a customizable head-mounted display (HMD) system that enhances the visual experience of people with low vision using real-time image processing techniques. The system offers five enhancement methods — magnification, contrast enhancement, edge…

  low vision · head-mounted display · vision enhancement · magnification · edge enhancement

• Exploring feasibility of wrist gestures for non-visual interactions with wearables

  Shirin Feiz, I. V. Ramakrishnan · 2019 · Proceedings of the 16th International Web for All Conference (W4A)

  This paper investigates the accessibility of wrist gestures as an input modality for people with visual impairments (PVIs) interacting with smartwatches. Smartwatches hold particular promise for PVIs: they are always available, enable one-handed use (important when the other…

  wearable technology · smartwatch · gesture-based interaction · visual impairment · blindness

• VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search

  Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, Ryen W. White · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper identifies the complementary strengths and weaknesses of screen readers and voice assistants (VAs) for blind web searchers, then presents VERSE (Voice Exploration, Retrieval, and SEarch), a prototype that merges the best of both technologies. An online survey of 53…

  screen readers · voice assistant · blind · web search · information retrieval

• WeLi: A Smartwatch Application to Assist Students with Intellectual and Developmental Disabilities

  Hui Zheng, Vivian Genaro Motti · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17)

  This poster paper presents WeLi (Wearable Life), a smartwatch application designed to assist students with intellectual and developmental disabilities (IDDs) in post-secondary educational environments. The system was developed for and deployed at Mason Life, a programme at…

  wearable technology · intellectual disability · developmental disability · special education · self-regulation

13 results.