Turning Heads: Designing Engaging Immersive Video Experiences to Support People with Intellectual Disability when Learning Everyday Living Skills
Laurianne Sitbon, Ross Brown, Lauren Fell · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353787
Summary
This paper presents findings from a participatory design process exploring how 360-degree video viewed through head-mounted displays can support people with intellectual disabilities in learning everyday living skills. The research was conducted over four iterative design cycles between June 2016 and September 2017, involving 12 participants with moderate to severe intellectual disabilities (including comorbidities such as Down syndrome, autism, and schizophrenia) and 6 support workers from a disability service organization. The core premise is that 360-degree video offers advantages over both traditional video (which is passive and lacks spatial immersion) and game-like virtual environments (which are expensive to produce and require complex controllers). 360-degree video can be cheaply filmed with affordable cameras, personalized to local contexts, and viewed on any smartphone with a VR headset like Google Cardboard. The iterative process explored three key design dimensions: viewpoint preferences (first-person, next-to-first-person with the facilitator visible at shoulder-mounted camera height, and stationary tripod views), engagement strategies (how to encourage participants to explore the 360-degree environment through head movements), and scaffolding approaches (how to introduce the technology and gradually build comfort). Videos depicted everyday settings including doing laundry, walking across a university campus, ordering coffee at a cafe, and visiting a dog park.
Key findings
Three key design principles emerged. First, participants were more comfortable with the technology when first introduced to a familiar scene — a 360-degree still photograph of a room they recognized — before viewing any new environments. This orientation step reduced initial anxiety about the technology and allowed participants to practice head movements in a safe, static context. Second, participants strongly preferred being "accompanied" by a visible in-video facilitator (the next-to-first-person viewpoint where the facilitator was visible at shoulder height) rather than pure first-person view (which caused motion sickness concerns from head jitter) or purely stationary views (which felt disconnected). The social presence of a recognizable person in the video was important for engagement and comfort. Third, participants engaged significantly more with the immersive environment — demonstrated through increased head movements — when prompted to look around from within the video rather than by external experimenters. In iteration 3, an engaging orientation video featuring a dog running through a park prompted participants to naturally follow the dog's path with head turns, dramatically increasing head movements from an average of 15.5 small and 8.5 large movements in iteration 2 to 19 small and 9.8 large movements. Participants were often more responsive to in-video instructions than to real-world instructions from researchers, and external prompting could actually distract them from the virtual content. Additional filming guidelines were established: avoid rapid camera rotation (use larger curves, transitions to black, or slowing turns); maintain steady pace; avoid abstract interactive symbols (like arrows); and use swivel chairs to support natural body rotation as participants often turned their bodies rather than just their heads.
Relevance
This research breaks new ground by applying 360-degree video technology specifically to life skills training for people with intellectual disabilities — a population often excluded from immersive technology research due to assumptions that VR would be overwhelming or uncomfortable for them. Contrary to these assumptions, all participants showed enthusiasm and engagement, with some maintaining attention beyond their typical span. The design guidelines are immediately actionable for practitioners and support workers creating training content: use affordable consumer 360-degree cameras; start with familiar static scenes; include a visible facilitator in the video; embed prompts to look around within the video content rather than giving external instructions; and film at a steady, unhurried pace. The scaffolding approach — progressing from familiar static image to engaging orientation video to instructional content — provides a reusable template for introducing any immersive technology to cognitively diverse populations. For accessibility practitioners, the finding that participants responded more to in-video cues than external verbal instructions highlights a broader principle: for users with intellectual disabilities, guidance embedded within the content itself is more effective than meta-instructions about how to use the technology. Support workers identified three compelling application areas: life skills training (transport, cooking, domestic tasks), sharing inaccessible experiences (beach trips, sporting events), and preparing for novel environments (airport journeys, new spaces) — all addressing real barriers to community participation.
Tags: intellectual disability · 360-degree video · virtual reality · life skills training · immersive learning · participatory design · cognitive accessibility · scaffolding · head-mounted display