Reviews

Search results

• Touching Movement: 3D Tactile Poses for Supporting Blind People in Learning Body Movements

  Kengo Tanaka, Xiyue Wang, Hironobu Takagi, Yoichi Ochiai, Chieko Asakawa · 2026 · Proceedings of the Twentieth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '26)

  Tanaka and colleagues investigate whether 3D-printed tactile models of whole-body poses can help blind learners acquire physical movements that are normally taught through visual demonstration. Verbal descriptions are notoriously inconsistent and struggle to convey nuance, while…

  tactile graphics · 3D printing · blindness and low vision · visual impairment · physical activity

• MotionBuddy: Exploring Tactile-Based Motion Learning with a Tabletop Humanoid Robot for Blind People

  Kengo Tanaka, Xiyue Wang, Hironobu Takagi, Yoichi Ochiai, Chieko Asakawa · 2026 · Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction (HRI '26)

  This HRI 2026 study by the same team behind the earlier 3D tactile-pose work asks whether a tabletop humanoid robot can convey dynamic body movements to blind learners more effectively than audio instruction alone. The motivation is that physical 3D models and tactile graphics…

  human-robot interaction · humanoid robot · assistive robotics · blindness and low vision · visual impairment

• Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization Tool

  Sanchita S. Kamath, Aziz N. Zeidieh, Venkatesh Potluri, Sile O'Modhrain, Kenneth Perry, JooYoung Seo · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Kamath et al. report an Experience-Based Co-Design (EBCD) process in which five blind or low-vision (BLV) researchers and one sighted collaborator built a web-native, multimodal prototype for exploring 3D surface plots - a class of visualisation central to VUV spectroscopy,…

  blind and low vision · data visualization · 3D visualization · sonification · spatial audio

• As Content and Layout Co-Evolve: TangibleSite for Scaffolding Blind People's Webpage Design through Multimodal Interaction

  Jiasheng Li, Zining Zhang, Zeyu Yan, Matthew Wong, Arnav Mittal, Ge Gao, Huaishu Peng · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper investigates how blind designers can author webpages end-to-end — generating content and arranging layout iteratively — rather than being limited to either content entry or layout inspection. The authors ran two rounds of co-design with three blind…

  accessible web design · blindness · tangible user interface · multimodal interaction · web authoring

• Augmenting Imagery with Multimodal Vibrotactile Representations: Touch, Feel, and Hear

  Mazen Salous, Matthias Kramer, Wilko Heuten, Charles Hudin, Susanne Boll, Larbi Abdenebaoui · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper addresses a long-standing gap in image accessibility for blind and visually impaired (BVI) users: while alt text, sonification, tactile graphics, and refreshable Braille displays convey shape, layout, and identity, they rarely communicate how an object…

  image accessibility · blind and low vision · vibrotactile feedback · haptic rendering · material perception

• Exploring the Impacts of Background Noise on Auditory Stimuli of Audio-Visual eHMIs for Hearing, Deaf, and Hard-of-Hearing People

  Wenge Xu, Foroogh Hajiseyedjavadi, Debargha Dey, Tram Thi Minh Tran, Mark Colley · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper investigates a critical but overlooked accessibility question in the design of external Human-Machine Interfaces (eHMIs) for automated vehicles (AVs): how do Deaf and Hard-of-Hearing (DHH) pedestrians experience audio-visual eHMIs, and how does real-world…

  deaf and hard of hearing · external human-machine interface · automated vehicles · pedestrian safety · multimodal interaction

• Towards Inclusive External Human-Machine Interface: Exploring the Effects of Visual and Auditory eHMI for Deaf and Hard-of-Hearing People

  Wenge Xu, Foroogh Hajiseyedjavadi, Kurtis Weir, Chukwuemeka Eze, Mark Colley · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper is a companion to Xu et al. 2026 (10.1145/3772318.3791557) but with a broader, two-stage inclusive-design focus: selecting appropriate visual eHMI concepts for Deaf and Hard-of-Hearing (DHH) pedestrians and then evaluating how visual and auditory eHMIs work…

  deaf and hard of hearing · external human-machine interface · automated vehicles · pedestrian safety · multimodal interaction

• FAME: Exploring Expressive Facial Avatars for Lyrical and Non-Lyrical Music Visualization for d/Deaf Individuals

  Suhyeon Yoo, Yifang Pan, Ashish Ajin Thomas, Karan Singh, Khai N. Truong · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper investigates whether expressive facial avatars can carry the emotional and structural richness of music — rhythm, pitch, melody, lyrics, and emotion — to d/Deaf and Hard of Hearing (DHH) audiences in ways that captions and abstract visualizers cannot. The…

  Deaf music · DHH · music accessibility · facial avatar · music visualization

• Autiverse: Eliciting Autistic Adolescents' Daily Narratives through AI-guided Multimodal Journaling

  Migyeong Yang, Kyungah Lee, Jinyoung Han, SoHyun Park, Young-Ho Kim · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Yang and colleagues present Autiverse, a tablet-based AI-guided multimodal journaling app for autistic adolescents with functional verbal abilities (formerly classified as Level 1 / high-functioning autism). The paper addresses a well-documented gap: although journaling is an…

  autism · adolescents · journaling · large language models · conversational agents

• VR Calm Plus: Coupling a Squeezable Tangible Interaction with Immersive VR for Stress Regulation

  He Zhang, Xinyang Li, Xingyu Zhou, Xinyi Fu · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Zhang and colleagues build and evaluate VR Calm Plus, a VR stress-regulation system that pairs an immersive Meta Quest 3 experience with a squeezable plush toy instrumented with two force-sensitive resistors (FSRs) and a wireless biosensing wristband measuring…

  virtual reality · stress management · haptics · affective haptics · tangible interaction

• HapticLens: Interactive Vibrotactile Haptic Generation from Spatially Localized Video Motion

  Kevin John, Hasti Seifi · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  HapticLens is an interactive method for generating single-actuator vibrotactile signals from arbitrary video content by letting a designer select a spatial region of interest and converting motion within that region into a vibration waveform in real time. The authors motivate…

  haptics · vibrotactile feedback · video-to-haptics · computer vision · multimodal interaction

• When Audio Is Enough: Design-Tradeoffs in Multi-Story MR Navigation

  Bilgehan Cagiltay, Selim Balcisoy · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI '26 exploratory study asks when an augmented-reality navigation aid can rely on audio alone. The authors argue that visual-first MR interfaces impose extra cognitive load and attention tunneling in high-stakes, cognitively demanding settings (e.g., first responders,…

  mixed reality · audio augmented reality · spatial audio · indoor navigation · wayfinding

• Touching a Cat Without Touch: Does Mid-Air Ultrasound Haptic Feedback Promote Relaxation in Virtual Cat Interaction?

  Juro Hosoi, Yuki Ban, Shin'ichi Warisawa · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Hosoi and colleagues investigate whether mid-air ultrasound haptics — tactile sensations produced by focused acoustic radiation pressure, with no device worn on the user's skin — can convey the feel of a virtual cat convincingly enough to support relaxation in VR. The paper…

  mid-air haptics · ultrasound haptics · virtual reality · haptic feedback · human-animal interaction

• AI4XR: AI in Extended Reality for 3D Scene Editing and Accessibility Design

  Junlong Chen · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26) — Doctoral Consortium

  This CHI '26 Doctoral Consortium paper summarises Junlong Chen's PhD research at the University of Cambridge on integrating AI — specifically large language models (LLMs) and vision-language models (VLMs) — into extended reality (XR) workflows. The research covers two…

  extended reality · virtual reality · artificial intelligence · large language models · vision-language models

• Beyond Additive Design: An Empirical Taxonomy of Multimodal STEM Accessibility Systems

  Madjid Sadallah, Benoit Encelle · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26)

  Sadallah and Encelle conduct a systematic review of 66 multimodal STEM accessibility systems for blind and visually impaired (BVI) users published between 2015 and 2025, drawn from the ACM Digital Library, IEEE Xplore, OpenAlex, PubMed, and Web of Science. Their central argument…

  STEM accessibility · multimodal interaction · cognitive load · sensory integration · blind and low vision

• Get In Touch with Your Seat: Accessible Seat Localization for Blind and Low Vision Travelers in Autonomous Shuttles

  Paul D. S. Fink, Justin R. Brown, Raina M. Movalia, Kyle J. James, Margaret E. Kastelein, Jacob Bond, Morgan E. Andrulis, Nicholas A. Giudice · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26)

  Fink, Brown, Movalia, and colleagues (University of Maine VEMI Lab, Grand Valley State University, and General Motors Global Research and Development) tackle a segment of the autonomous-vehicle accessibility problem that has received little attention: helping a blind or…

  autonomous vehicles · blind and low vision · transportation accessibility · haptics · spatial audio

• AR Haptic-Audio Conversion for Non-Visual Product Understanding in Smartphone AR

  Satomi Tokida, Ayaka Tsutsui, Norimasa Kobori, Matthew Gillingham, Bektur Ryskeldiev · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26)

  Tokida and colleagues (Mercari R4D, University of Tokyo, University of Tsukuba) tackle a specific gap in e-commerce accessibility: the AR 'view-in-room' features now common in online marketplaces (IKEA Place, Amazon AR View) assume sighted interaction and leave blind and…

  blind and low vision · augmented reality · mobile AR · haptics · vibrotactile

• Pin City Book: A PCB-based Tangible User Interface for Location-based Puzzle Games

  Yibing Chen, Yutong Liu, Zihan Zhou, Yifan Wang, Sihan Wang, Yunyang Di, Quan Li · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA ’26)

  This CHI 2026 Extended Abstract introduces Pin City Book, a PCB-based tangible user interface (TUI) platform for location-based puzzle games (LBPGs). The authors argue that current LBPGs are split between paper kits (cumbersome, no feedback) and mobile apps (screen-bound,…

  tangible user interface · multimodal interaction · location-based games · maker accessibility · haptic feedback

• Investigating 'Touch and Talk' for Blind and Low Vision People: Science Communication Assistance Through Exploring Multiple Tactile Objects

  Ayaka Tsutsui, Xiyue Wang, Hironobu Takagi, Chieko Asakawa · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper investigates how interactive dialogue and multiple tactile 3D models can enhance science communication for blind and low vision (BLV) users. The research addresses a gap in existing tactile learning tools: most Interactive 3D Models (I3Ms) rely on pre-defined audio…

  tactile graphics · blind and low vision · science communication · 3D printed models · multimodal interaction

• GestureVoice: Enabling Multimodal Text Editing for Blind Users Using Gestures and Voice

  Prerna Khanna, Sai Pravallika Reddy, IV Ramakrishnan, Xiaojun Bi, Aruna Balasubramanian · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces GestureVoice, a multimodal text editing system that enables blind smartphone users to edit text using mid-air hand gestures detected by a smartwatch combined with voice commands, eliminating the need for touchscreen interaction. The research addresses a…

  text editing · blind users · multimodal interaction · gesture recognition · voice commands

• Designing Accessible Calendar Tools for Blind and Low-Vision Users

  Mahmut Erdemli · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This extended abstract investigates the accessibility challenges blind and low vision (BLV) users face with calendar applications and explores how voice-activated personal assistants (VAPAs) like Siri and Alexa can enhance calendar usability. The study employed a mixed-methods…

  blindness · low vision · calendar accessibility · voice assistants · co-design

• Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing Viewers

  Caluã de Lacerda Pataca, Saad Hassan, Lloyd May, Michelle M Olson, Toni D'aurio, Roshan L Peiris, Matt Huenerfauth · 2025 · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25)

  This paper explores a multimodal approach to affective captioning — captions that convey not just the words a speaker says but the emotional dimensions of their voice — for d/Deaf and Hard-of-Hearing (dhh) viewers. Prior work has shown that typographic modulations such as…

  affective captioning · haptics · deaf and hard of hearing · multimodal interaction · captions

• MAIDR Meets AI: Exploring Multimodal LLM-Based Data Visualization Interpretation by and with Blind and Low-Vision Users

  JooYoung Seo, Sanchita S. Kamath, Aziz Zeidieh, Saairam Venkatesh, Sean McCurry · 2024 · ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper investigates how blind and low-vision (BLV) users interact with large language models to interpret data visualizations, building on the authors' previously developed MAIDR (Multimodal Access and Interactive Data Representation) framework. MAIDR already provides…

  blind and low vision · data visualization · large language models · generative AI · sonification

• "We Musicians Know How to Divide and Conquer": Exploring Multimodal Interactions To Improve Music Reading and Memorization for Blind and Low Vision Learners

  Leon Lu, Chase Crispin, Audrey Girouard · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper investigates how multimodal assistive technologies (MATs) combining sound, vibration, and touch can improve music reading and memorization for blind or low-vision (BLV) musicians and learners. The study involved nine BLV participants from The FMDG Music School in New…

  visual impairment · music accessibility · Braille music · multimodal interaction · vibrotactile feedback

• A Recipe for Success? Exploring Strategies for Improving Non-Visual Access to Cooking Instructions

  Franklin Mingzhe Li, Ashley Wang, Patrick Carrington, Shaun K. Kane · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2024)

  This paper investigates how people with vision impairments access and follow cooking recipes, identifying practices, challenges, and design opportunities for more accessible kitchen technologies. The researchers conducted semi-structured interviews with 20 blind cooks (ranging…

  blind · visual impairment · cooking accessibility · recipe access · assistive technology