shapeCAD: An Accessible 3D Modelling Workflow for the Blind and Visually-Impaired Via 2.5D Shape Displays
Alexa F. Siu, Son Kim, Joshua A. Miele, Sean Follmer · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019) · doi:10.1145/3308561.3353782
Summary
This paper presents shapeCAD, an accessible 3D modelling workflow that enables people who are blind or visually impaired (BVI) to author, explore, and modify 3D models using a combination of declarative programming (OpenSCAD scripts) and a 2.5D tactile shape display for real-time haptic feedback. Existing computer-aided design tools rely heavily on visual graphical interfaces, forcing BVI users to work through sighted intermediaries or wait hours for 3D prints to verify their designs. shapeCAD addresses this by coupling code-based modelling — where users define 3D geometry through OpenSCAD’s constructive solid geometry (CSG) operations — with a physical pin-based display (12×24 actuated pins, 4.8mm square with 2mm spacing) that dynamically renders the model for tactile exploration. The system was developed through participatory co-design sessions with three blind users of mixed programming ability, then validated through a usability evaluation with five BVI programmers. The workflow uses Microsoft Visual Studio Code as the accessible programming environment, with a custom extension that compiles and renders OpenSCAD files directly. A Unity application manages the shape display interface, providing audio feedback, 3D mouse input for navigation, and slider controls for zoom and cross-section views.
Key findings
The co-design process revealed that code and tactile representations compensate for each other’s limitations: the code provides precise geometric detail that the low-resolution display cannot convey (e.g., exact dimensions, boolean operations), while the tactile display provides spatial understanding that code alone cannot communicate. Users adopted a consistent exploration strategy: first viewing all sides at a scale that fits the display, then zooming into specific areas for detail. Key interaction features emerged from co-design: 90-degree discrete rotation increments (finer angles were unpredictable), a reset command to return to a known position (rated the most useful feature), split view showing top-down and bottom-up views simultaneously, section view for slicing through models to reveal internal geometry and overhangs, and a "reveal hidden differences" mode using pin vibration to indicate geometry clipping below the display. In evaluation, four of five participants completed all controlled tasks successfully, with transformation tasks averaging 6.4 minutes and construction tasks 14.6 minutes. In a free-form creation task, participants designed objects including a staircase stand, tall glass cup, truck with carriage, and cube with dome in an average of 17 minutes. The system received a SUS usability score of 70, with participants reporting low frustration and good perceived performance despite high mental demand and effort.
Relevance
shapeCAD demonstrates that BVI people can independently create 3D models when given accessible tools — a finding with significant implications for STEM education, digital fabrication, and the Maker Movement. The insight that programming and physical rendering form a complementary feedback loop is a powerful design principle for accessible creative tools generally. As one participant noted, being able to control and create 3D models is "just revolutionary and very exciting" for someone who currently cannot access design tools independently. The work connects to a broader argument that unless BVI makers have direct access to design and fabrication tools, they are "forced to work through sighted intermediaries, reducing agency, availability, and creativity." For accessibility practitioners, the specific interaction design decisions — discrete rotations, reset functionality, split and section views, vibration for hidden geometry — provide a toolkit of techniques applicable to any system conveying 3D information haptically. The open-source VS Code extension is available for immediate use.
Tags: 3D printing · blind · low vision · tactile displays · haptic technology · accessible authoring · maker movement · CAD · shape display · participatory design · STEM accessibility