← Writing · Glossary →

Reviews

The literature-review database. Every paper Bob has reviewed (he has read many more), with a short summary, key findings, and tags. Browse, filter, search.

Search results

  • The Accessibility of Data Visualizations on the Web for Screen Reader Users: Practices and Experiences During COVID-19

    Danyang Fan, Alexa Fay Siu, Hrishikesh Rao, Gene Sung-Ho Kim, Xavier Vazquez, Lucy Greco, Sile O'Modhrain, Sean Follmer · 2023 · ACM Transactions on Accessible Computing

    This comprehensive mixed-methods study examines data visualization accessibility through three complementary investigations: an accessibility audit of 87 COVID-19 visualizations, an online survey of 127 screen reader users, and contextual inquiry with 12 participants. The…

    data visualization · screen readers · visual impairment · web accessibility · accessibility audit

  • Mathematical Content Browsing for Print-disabled Readers Based on Virtual-world Exploration and Audio-visual Sensory Substitution

    Rynhardt Kruger, Febe De Wet, Thomas Niesler · 2023 · ACM Transactions on Accessible Computing

    This research addresses a critical accessibility gap: mathematical equations in PDF documents are largely inaccessible to blind and visually impaired readers. While standards like MathML exist for encoding accessible mathematics, most scientific and technical papers are…

    mathematical accessibility · sensory substitution · PDF accessibility · blind users · sonification

  • IMAGE: A Deployment Framework for Creating Multimodal Experiences of Web Graphics

    Juliette Regimbal, Jeffrey R. Blum, Jeremy R. Cooperstock · 2022 · Proceedings of the 19th International Web for All Conference (W4A)

    This short paper from McGill University introduces IMAGE (Internet Multimodal Access to Graphical Exploration), an open-source framework for converting web graphics into accessible multimodal outputs including audio, haptic, and text representations for blind and low vision…

    multimodal · web graphics · image accessibility · haptic feedback · sonification

  • Uncovering Visually Impaired Gamers' Preferences for Spatial Awareness Tools Within Video Games

    Vishnu Nair, Shao-en Ma, Ricardo E. Gonzalez Penuela, Yicheng He, Karen Lin, Mason Hayes, Hannah Huddleston, Matthew Donnelly, Brian A. Smith · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

    This paper investigates how visually impaired players (VIPs) gain spatial awareness within 3D video games by comparing four leading spatial awareness tool (SAT) approaches. The researchers built Dungeon Escape, a 3D third-person adventure game using Unity, featuring four dungeon…

    game accessibility · visual impairment · blindness · spatial awareness · audio navigation

  • CodeWalk: Facilitating Shared Awareness in Mixed-Ability Collaborative Software Development

    Venkatesh Potluri, Maulishree Pandey, Andrew Begel, Michael Barnett, Scott Reitherman · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

    This paper presents CodeWalk, a set of accessibility features added to Microsoft's Live Share extension for Visual Studio Code, designed to make remote synchronous code collaboration accessible to blind or visually impaired (BVI) developers. The COVID-19 pandemic accelerated…

    blind developers · collaborative programming · IDE accessibility · screen readers · workspace awareness

  • Planning Your Journey in Audio: Design and Evaluation of Auditory Route Overviews

    Nida Aziz, Tony Stockman, Rebecca Stewart · 2022 · ACM Transactions on Accessible Computing

    This research develops and evaluates an auditory route overview system that enables blind users to preview walking routes before embarking on journeys. The system addresses a critical gap: while many navigation aids support live guidance, few tools allow blind travelers to gain…

    blind navigation · auditory display · route planning · auditory icons · earcons

  • Multi-touch Exploration and Sonification of Line Segments

    Dragan Ahmetovic, Cristian Bernareggi, Sergio Mascetti, Federico Pini · 2021 · Proceedings of the 18th International Web for All Conference (W4A)

    This paper presents SoundLines, a mobile app designed to help children with visual impairments develop spatial exploration skills through touchscreen interaction coupled with audio (sonification) feedback. The app is structured as a game where a kitten must be guided to find its…

    visual impairment · sonification · spatial cognition · mobile accessibility · tactile accessibility

  • COVID-19 Highlights the Issues Facing Blind and Visually Impaired People in Accessing Data on the Web

    Alexa F. Siu, Danyang Fan, Gene S-H Kim, Hrishikesh V. Rao, Xavier Vazquez, Sile O'Modhrain, Sean Follmer · 2021 · Proceedings of the 18th International Web for All Conference (W4A)

    This mixed-methods study examines how blind and visually impaired (BVI) people experienced accessing data-driven information on the web during the COVID-19 pandemic — a period when data visualizations such as infection curves, maps of hotspots, and trend charts became central to…

    data visualization · blind and low vision · web accessibility · COVID-19 · screen readers

  • Auditory feedback to compensate audible instructions to support people with visual impairment

    Gabriele Galimberti · 2021 · ASSETS '21: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility

    This doctoral consortium extended abstract addresses a practical challenge faced by people with visual impairments who rely on auditory feedback from mobile devices: background noise in real-world mobility contexts can mask device audio output, degrading the information it…

    visual impairment · auditory feedback · sonification · mobile accessibility · navigation

  • Iterative Design of Sonification Techniques to Support People with Visual Impairments in Obstacle Avoidance

    Giorgio Presti, Dragan Ahmetovic, Mattia Ducci, Cristian Bernareggi, Luca A. Ludovico, Adriano Baratè, Federico Avanzini, Sergio Mascetti · 2021 · ACM Transactions on Accessible Computing

    This paper presents WatchOut, a sonification system that conveys real-time obstacle information to blind or visually impaired (BVI) people through non-verbal audio cues. While white canes detect obstacles only within about 1 meter and miss elevated hazards, computer vision on…

    visual impairment · blindness · sonification · obstacle avoidance · orientation and mobility

  • Designing Embodied Musical Interaction for Children with Autism

    Grazia Ragone · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

    This paper presents OSMoSIS (Observation of Social Motor Synchrony with an Interactive System), an interactive musical system designed to support embodied musical interaction for children with Autism Spectrum Conditions (ASC) during music therapy sessions. Developed by the…

    autism · music therapy · embodied interaction · motion capture · sonification

  • SoundLines: Exploration of Line Segments through Sonification and Multi-touch Interaction

    Dragan Ahmetovic, Cristian Bernareggi, Sergio Mascetti · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

    This paper presents SoundLines, a mobile application designed to help children with visual impairments explore and understand line segments on a touchscreen using sonification and multi-touch interaction. The system addresses a fundamental challenge in early education for blind…

    sonification · visual impairments · children · touchscreen accessibility · multi-touch interaction

  • Haptic and Auditive Mesh Inspection for Blind 3D Modelers

    Sebastian Lieb, Benjamin Rosenmeier, Thorsten Thormählen, Knut Buettner · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

    This paper addresses a critical gap in accessible 3D modeling for blind users. While constructive geometry programming languages like OpenSCAD allow blind modelers to write text-based code to create 3D objects (accessible via screen readers and braille displays), there has been…

    blindness · 3D modeling · haptic technology · sonification · 3D printing

  • ReCog: Supporting Blind People in Recognizing Personal Objects

    Dragan Ahmetovic, Daisuke Sato, Uran Oh, Tatsuya Ishihara, Kris Kitani, Chieko Asakawa · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

    ReCog is a smartphone application designed to help blind users recognize their own personal objects — items like specific clothing, handmade goods, medicines, or family photos that cannot be identified by general-purpose recognizers such as Seeing AI or TapTapSee. The authors…

    visual impairment · blindness · object recognition · computer vision · deep learning

  • Multimodal Exploration of Mathematical Function Graphs with AudioFunctions.web

    Dragan Ahmetovic, Niccolò Cantù, Cristian Bernareggi, João Guerreiro, Sergio Mascetti, Anna Capietto · 2019 · Proceedings of the 16th International Web for All Conference (W4A)

    This demonstration paper presents AudioFunctions.web, a web-based system designed to make mathematical function graphs accessible to people who are blind or have visual impairments. Function graphs are a fundamental tool in mathematics education and STEM fields, yet they remain…

    sonification · mathematics accessibility · visual impairment · blindness · STEM accessibility

  • AudioFunctions.web: Multimodal Exploration of Mathematical Function Graphs

    Dragan Ahmetovic, Cristian Bernareggi, João Guerreiro, Sergio Mascetti, Anna Capietto · 2019 · Proceedings of the 16th International Web for All Conference (W4A)

    This full research paper presents AudioFunctions.web, a web application that enables blind and visually impaired people to explore mathematical function graphs through a combination of sonification, earcons, and speech synthesis. The system is the platform-independent successor…

    sonification · mathematics accessibility · visual impairment · blindness · STEM accessibility

  • Revisiting Blind Photography in the Context of Teachable Object Recognizers

    Kyungjun Lee, Jonggi Hong, Simone Pimento, Ebrima Jarjue, Hernisa Kacorri · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

    This paper introduces a real-time audio-haptic feedback system to help people with visual impairments frame objects in their smartphone camera when training teachable object recognizers. The challenge is that teachable recognizers — which let users train personalized models to…

    blind photography · teachable object recognizer · computer vision · deep learning · visual impairment

  • Making Nonvisually: Lessons from the Field

    Cynthia L. Bennett, Abigale Stangl, Alexa F. Siu, Joshua A. Miele · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

    This experience report shares lessons from a team of researchers, activists, and blind makers who conducted workshops introducing Arduino electronics to blind hobbyists and guided assembly of an accessible voltmeter prototype. The authors — including blind HCI researcher Cynthia…

    maker movement · blind · DIY assistive technology · Arduino · participatory design

  • Non-Visual Beats: Redesigning the Groove Pizza

    William Payne, Alex Xu, Amy Hurst, S. Alex Ruthmann · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

    This demonstration paper describes the accessible redesign of the Groove Pizza, a popular free web-based drum step-sequencer developed by NYU’s Music Experience Design Lab (MusEDLab) that reaches thousands of users per month. The original Groove Pizza uses a circular visual…

    music accessibility · blind · visual impairment · screen readers · sonification

  • WatchOut: Obstacle Sonification for People with Visual Impairment or Blindness

    Giorgio Presti, Dragan Ahmetovic, Mattia Ducci, Cristian Bernareggi, Luca Ludovico, Adriano Baratè, Federico Avanzini, Sergio Mascetti · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

    This paper presents WatchOut, a sonification technique that conveys real-time information about obstacle characteristics to people who are blind or visually impaired (BVI) through non-verbal sound, enabling them to avoid obstacles while walking. The white cane, the primary…

    sonification · obstacle avoidance · blind · low vision · computer vision

  • BBeep: A Sonic Collision Avoidance System for Blind Travellers and Nearby Pedestrians

    Seita Kayukawa, Keita Higuchi, João Guerreiro, Shigeo Morishima, Yoichi Sato, Kris Kitani, Chieko Asakawa · 2019 · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19)

    This paper presents BBeep, an assistive suitcase-shaped system designed to help blind travellers navigate crowded public spaces such as international airports, train stations, and shopping malls. The authors argue that existing blind-navigation research has focused largely on…

    blind navigation · obstacle avoidance · collision avoidance · assistive technology · wearable technology

  • Design and Evaluation of a Multimodal Science Simulation

    Brianna J. Tomlinson, Prakriti Kaini, Siyan Zhou, Taliesin L. Smith, Emily B. Moore, Bruce N. Walker · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18)

    This demonstration paper presents a multimodal version of PhET's John Travoltage interactive physics simulation, designed to support learners with and without visual impairments in exploring static electricity concepts. The key design goal was creating a single simulation with…

    STEM accessibility · sonification · multimodal interface · visual impairment · science education

  • Video Gaming for the Vision Impaired

    Manohar Swaminathan, Sujeath Pareddy, Tanuja Sunil Sawant, Shubi Agarwal · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

    This Microsoft Research demo paper presents the Responsive Spatial Audio Cloud (ReSAC), a novel interaction toolkit designed to make mainstream video games accessible to people with visual impairments. The research is motivated by the finding that visually impaired people want…

    blindness · game accessibility · spatial audio · sonification · 3D sound

  • On the Evaluation of Novel Sonification Techniques for Non-Visual Shape Exploration

    Sergio Mascetti, Andrea Gerino, Cristian Bernareggi, Lorenzo Picinali · 2017 · ACM Transactions on Accessible Computing (TACCESS)

    This paper proposes and evaluates six novel sonification techniques for enabling blind and visually impaired users to explore and recognize shapes on touchscreen devices, comparing them against two existing techniques from the literature. The motivation is that graphical…

    sonification · visual impairment · STEM accessibility · touchscreen · shape recognition

  • Sensory Glasses for the Visually Impaired

    Michael Barney, Jonathan Kilner, Gilmar Brito, Aida Araújo, Meuse Nogueira · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

    This demonstration paper presents the design and development of a low-cost wearable assistive device — sensory glasses — intended to help visually impaired people navigate their surroundings. The device addresses a well-known limitation of the traditional white cane: it cannot…

    assistive technology · blindness · wearable technology · sonification · navigation