Reviews

Search results

• Measuring the Accuracy of Automatic Speech Recognition Solutions

  Korbinian Kuhn, Verena Kersken, Benedikt Reuter, Niklas Egger, Gottfried Zimmermann · 2024 · ACM Transactions on Accessible Computing

  This study provides independent, comprehensive benchmarking of 11 common automatic speech recognition (ASR) services to assess their real-world accuracy for accessibility purposes. The research addresses a critical gap: while vendors claim "state-of-the-art accuracy" and…

  automatic speech recognition · ASR · captions · deaf and hard of hearing · transcription

• Exploring the Strategies People with Parkinson's Disease Use to Self-track Symptoms and Medications

  Charlotte Tang, Imrul K. Shuva, Matthew Thelen, Linda Zhu, Nathaniel S. Miller · 2024 · ACM Transactions on Accessible Computing

  This qualitative study investigates how people with Parkinson's Disease (PwPD) track their symptoms, medications, and physical activities, with the goal of informing inclusive design of self-tracking technologies. The researchers conducted semi-structured interviews with 26…

  Parkinson's disease · self-tracking · chronic illness · health technology · inclusive design

• System-class Accessibility: The Architectural Support for Making a Whole System Usable by People with Disabilities

  Chris Fleizach, Jeffrey P. Bigham · 2024 · ACM Queue

  This article introduces the concept of "system-class accessibility" — the architectural support built into an operating system to make the entire platform usable by people with disabilities. Written by Chris Fleizach (who led the development of VoiceOver on iOS at Apple) and…

  accessibility API · screen readers · VoiceOver · iOS accessibility · operating systems

• Exploring the Role of Social Support When Integrating Generative AI in Small Business Workflows

  Quentin Romero Lauro, Jeffrey P. Bigham, Yasmine Kotturi · 2024 · Companion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing (CSCW Companion '24)

  This paper investigates how small business owners from resource-constrained communities leverage their offline social networks to integrate generative AI technologies into their business workflows. The researchers interviewed 11 participants — seven entrepreneurs and four…

  generative AI · entrepreneurship · social support · technology adoption · digital divide

• UIClip: A Data-driven Model for Assessing User Interface Design

  Jason Wu, Yi-Hao Peng, Xin Yue Amanda Li, Amanda Swearngin, Jeffrey P. Bigham, Jeffrey Nichols · 2024 · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST '24)

  This paper introduces UIClip, a computational model that automatically assesses UI design quality and visual relevance from a screenshot and natural language description. Built on OpenAI's CLIP B/32 architecture (151 million parameters), UIClip is fine-tuned on a novel…

  UI design · machine learning · design quality assessment · computer vision · CLIP

• Towards Automated Accessibility Report Generation for Mobile Apps

  Amanda Swearngin, Jason Wu, Xiaoyi Zhang, Esteban Gomez, Jen Coughenour, Rachel Stukenborg, Bhavya Garg, Greg Hughes, Adriana Hilliard, Jeffrey P. Bigham, Jeffrey Nichols · 2024 · ACM Transactions on Computer-Human Interaction

  This paper presents a system for automatically generating whole-app accessibility reports for mobile apps, addressing key limitations of existing accessibility scanning tools. The work begins with formative interviews with eight accessibility QA professionals at a large…

  automated testing · accessibility testing · mobile accessibility · app crawling · machine learning

• "This really lets us see the entire world:" Designing a conversational telepresence robot for homebound older adults

  Yaxin Hu, Laura Stegner, Yasmine Kotturi, Caroline Zhang, Yi-Hao Peng, Faria Huq, Yuhang Zhao, Jeffrey P. Bigham, Bilge Mutlu · 2024 · Proceedings of the 2024 ACM Designing Interactive Systems Conference (DIS '24)

  This paper investigates how conversational telepresence robots can help homebound older adults interact with the external world. Homebound status — defined as rarely or never leaving home due to illness, injury, or environmental constraints — affects a growing proportion of…

  telepresence robots · older adults · homebound · social isolation · participatory design

• 'Your Duties Are To Sweep A Floor Remotely': Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers' Successful Use of Digital Platforms

  Sara Kingsley, Michael Six Silberman, Clara Wang, Robert Lambeth, Jiayin Zhi, Motahhare Eslami, Beibei Li, Jeffrey Bigham · 2024 · Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work (CHIWORK)

  This paper investigates barriers that low-income job-seekers face when using digital platforms to find work, based on 27 semi-structured interviews with US residents earning under $45,000 who had searched for paid work in the previous two years. The participants — 30% of whom…

  digital inclusion · digital divide · employment · disability employment · low-income users

• COMPA: Using Conversation Context to Achieve Common Ground in AAC

  Stephanie Valencia, Jessica Huynh, Emma Y Jiang, Yufei Wu, Teresa Wan, Zixuan Zheng, Henny Admoni, Jeffrey P Bigham, Amy Pavel · 2024 · Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24)

  This paper presents COMPA, a browser extension add-on tool designed to help AAC (Augmentative and Alternative Communication) users and their conversation partners achieve common ground during online group conversations. The core problem is speed asymmetry: AAC users may take…

  AAC · augmentative and alternative communication · communication accessibility · group conversation · common ground

• BentoMuseum: 3D and Layered Interactive Museum Map for Blind Visitors

  Xiyue Wang, Seita Kayukawa, Hironobu Takagi, Chieko Asakawa · 2024 · Communications of the ACM

  BentoMuseum proposes a novel museum map format designed to help blind visitors access the multidimensional information of a complex, multi-floor museum before and during a visit. Unlike conventional tactile maps that depict a single floor layout and struggle to convey volumetric…

  museum accessibility · blindness and low vision · tactile map · audio-tactile interaction · 3D printing

• Snap&Nav: Smartphone-based Indoor Navigation System For Blind People via Floor Map Analysis and Intersection Detection

  Masaya Kubota, Masaki Kuribayashi, Seita Kayukawa, Hironobu Takagi, Chieko Asakawa, Shigeo Morishima · 2024 · Proceedings of the ACM on Human-Computer Interaction (MobileHCI)

  Snap&Nav is a smartphone-based indoor navigation system for blind travellers that works in any building with a visible floor map, without requiring the building owner to pre-build a digital map, install BLE beacons, or deploy any other localisation infrastructure. The authors…

  blindness and low vision · indoor navigation · wayfinding · map-less navigation · intersection detection

• ChitChatGuide: Conversational Interaction Using Large Language Models for Assisting People with Visual Impairments to Explore a Shopping Mall

  Yuka Kaniwa, Masaki Kuribayashi, Seita Kayukawa, Daisuke Sato, Hironobu Takagi, Chieko Asakawa, Shigeo Morishima · 2024 · Proceedings of the ACM on Human-Computer Interaction (MobileHCI)

  ChitChatGuide is a smartphone-based indoor navigation system that wraps a GPT-4-powered conversational interface around an existing BLE-beacon localisation stack (HULOP) to support something most blind-navigation research overlooks: casual, purpose-less exploration — the blind…

  blindness and low vision · large language model · indoor navigation · wayfinding · conversational agent

• Caption Royale: Exploring the Design Space of Affective Captions from the Perspective of Deaf and Hard-of-Hearing Individuals

  Caluã de Lacerda Pataca, Saad Hassan, Nathan Tinker, Roshan Lalintha Peiris, Matt Huenerfauth · 2024 · CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

  This CHI 2024 paper from Rochester Institute of Technology and Tulane tackles a concrete design question: if we want captions to convey a speaker's emotion — not just their words — which typographic modulations should we use? Prior work had established that affective captions…

  captioning · affective captions · expressive captions · typography · valence