Math Melodies: Supporting Visually Impaired Primary School Students in Learning Math
Dragan Ahmetovic, Valeria Alampi, Cristian Bernareggi, Andrea Gerino, Sergio Mascetti · 2017 · Proceedings of the 14th International Web for All Conference (W4A) · doi:10.1145/3058555.3058583
Summary
This demonstration paper presents Math Melodies, a free iPad application designed to teach mathematics to primary school children who are blind or visually impaired, while simultaneously engaging sighted peers. Mathematics education poses particular challenges for visually impaired students because both traditional workbooks and digital tools rely heavily on visual elements — images for engagement, graphical elements like set operations, two-dimensional layouts such as column arithmetic, and spatial interactions like drawing or inserting digits in tables. Existing alternatives using audio or haptic feedback either require a supervisor or expensive specialized hardware. Math Melodies addresses these challenges through a multimodal approach on a mainstream tablet device. The app presents 19 different exercise types across 10 chapters (two per primary school grade), with approximately 30 exercises per chapter at increasing difficulty levels. Exercises are embedded in an adventure story where math problems serve as puzzles to progress (e.g., solving an addition to unlock a treasure chest). All visual elements are paired with "audio-icons" — recognizable sounds like a frog's call or an approaching car — enabling blind students to explore the interface through touch while sighted students enjoy colorful graphics. Exercises use grid layouts accessible via screen reader, with a simplified on-screen keyboard for input. The story can be read by sighted students or voiced through text-to-speech synthesis. The app was developed using participatory design with 4 specialist teachers and 3 blind primary school children.
Key findings
An evaluation with 2 sighted and 3 blind primary school children showed that after at most two minutes of supervised training, all participants could interact with the system independently, and all found it accessible and entertaining. Since publication, Math Melodies has been downloaded over 14,000 times, demonstrating significant real-world adoption. The app successfully bridges the gap between sighted and visually impaired learners by using dual audio-visual elements — every graphical element has a corresponding audio-icon, so the same content works for both populations simultaneously. This inclusive design means blind and sighted children can use the app in the same classroom setting. The reinforcement learning approach (repeating exercises at increasing difficulty) proved effective across ability levels. Key design decisions included using large fonts and high contrast for low-vision users, organizing exercise elements in grid layouts to reduce cognitive load during audio exploration, and progressing the narrative through increasingly unfamiliar environments (apartment to city to seaside to mountain) to build comprehension gradually.
Relevance
Math Melodies demonstrates that mainstream tablet devices can serve as effective, low-cost platforms for accessible math education without requiring expensive specialized hardware. The inclusive design approach — creating a single application that works for both sighted and blind children — is more practical and socially integrating than separate tools for different ability levels. For educators and developers, the audio-icon concept (pairing every visual element with a recognizable sound) provides a replicable pattern for making visual educational content accessible. The participatory design process involving both specialist teachers and blind children ensured the tool met real educational needs. The 14,000+ downloads indicate genuine demand for accessible math education tools. The app's availability as a free iPad application funded through crowdfunding offers a model for sustainable distribution of accessible educational software. A limitation is the small formal evaluation sample, though the download numbers and remote usage data collection provide broader evidence of utility.
Tags: visual impairment · blindness · education accessibility · mathematics accessibility · children · iPad · touchscreen accessibility · audio icons · multimodal interaction · inclusive design · screen reader · assistive technology · serious games · participatory design · text-to-speech