Using Augmented Reality and Concept Mapping to Improve Ability to Master Social Relationships and Social Reciprocity for Children with Autism Spectrum Disorder

摘要

In this study, we use augmented reality (AR) technology combined with the visual framework of the Concept Map (CM) to help children with autism spectrum disorder (ASD) apply the learned abstract social concepts and complex social relationships to the conceptual connection and establishment of social relationships in a structured and visual way. We hope to reduce the complexity and difficulty of social training for children with ASD through a teaching framework with social context and visual structure, and at the same time give children with ASD more contextual change and flexibility in teaching. In the study, a total of four 7- to 9-year-old children with high-functioning ASD were recruited as the research subjects. They were given the AR teaching aid based on the CM design. The AR-based Concept Map (ARCM) social training system can generate corresponding 3D virtual characters and corresponding virtual social situations for different social relationships, and simultaneously give children with ASD 3D animation feedback while they watch the 3D virtual characters and social reciprocity behavior. Children with ASD can master and understand different social-relationship cognitions according to different social conditions and situations in the game. It also can be extended to the interaction state between different social objects, according to the current social context clues, through role-playing to show appropriate social reciprocity behavior. Finally, we believe that AR technology combined with the CM Framework is helpful to train autistic children's social reciprocal ability, and thus, is worth developing as a teaching strategy and training method.