Semiotics Contributions to Accessible Interface Design
María Inés Laitano · 2015 · Proceedings of the 12th International Web for All Conference (W4A) · doi:10.1145/2745555.2746673
Summary
This extended abstract argues that semiotic theory — the study of signs and meaning-making — can complement WCAG-based approaches to produce more meaningfully accessible interfaces. Laitano contrasts the WAI model, which centres on content (information plus markup) accessed through user agents, with a semiotic model that frames interface design as communication between designers and users. In semiotics, designers have a deliberate communication strategy toward their target audience, and the interface carries an "implicit user" — a hypothesis about user behaviour, experience, and expectations. Communication succeeds when the real user recognises themselves in this implicit user. The paper demonstrates the difference through a case study: a research institute website whose homepage uses six artwork images, each symbolically representing a research team and conveying regional cultural identity. Following a strict WCAG content approach, these images within hyperlinks would receive empty alt attributes (as decorative images within link text), completely erasing the designer's communication strategy for users who cannot see the images. A semiotic approach instead seeks to preserve that strategy through alternative modalities — in this case, short electroacoustic sound compositions combining musical elements (evoking regional identity through semantic listening) with auditory icons (whose real-world sound referents represent each team).
Key findings
The paper identifies three specific areas where semiotic analysis improves on a pure WCAG content approach. First, image alternatives: rather than treating symbolic artwork as decorative and providing empty alt text, a semiotic approach recognises the communicative intent and provides equivalent non-visual representations (auditory icons and sound compositions). Second, reading order: WCAG suggests sequential left-to-right, top-to-bottom navigation with skip links, but semiotic analysis of the visual layout reveals that the main content (artworks) is visually prioritised over the header — so the non-visual reading order should begin with main content to preserve the intended communication hierarchy. Third, link labelling: WCAG requires that link text describe the link's purpose ("Log in"), but a semiotic approach considers the target audience, suggesting "Members login" to help users identify whether the link is relevant to them. Laitano concludes that complementing WCAG with semiotics moves from "content accessibility" to "communicational accessibility" — ensuring that the designer's intended message, not just the raw information, reaches all users.
Relevance
This paper challenges a common assumption in accessibility practice: that meeting WCAG success criteria is sufficient for meaningful access. By showing how technically compliant solutions (empty alt on decorative images, standard reading order, minimal link text) can strip away communicative intent, Laitano highlights a gap between standards compliance and genuine equivalent experience. The concept of "communicational accessibility" — preserving the designer's strategy across modalities — is a useful frame for practitioners who want to move beyond checkbox compliance. The auditory icon approach for conveying symbolic meaning is a creative alternative to descriptive alt text for abstract or artistic imagery. However, this is a brief extended abstract presenting a single case study without user evaluation, and some proposals (like electroacoustic compositions for navigation) may not be practical at scale. The core insight — that accessibility should preserve communicative intent, not just expose content — remains valuable for anyone writing alt text or designing multimodal interfaces.
Tags: semiotics · interface design · WCAG · alt text · communication strategy · auditory icons · accessible design · design theory
Standards referenced: WCAG 2.0