Improving communication with a child with ASD has become an indispensable need in order to make the life smooth for the special child. Research has shown that communication gets driven by mood dynamics, non-verbal interactions, gestural communication and expressions. With the growth in technology, mixed reality and eye tracking are playing a major role in imparting experiences and making us learn about an environment without having to physically be in them. This research work explores how mixed reality can take a child with ASD through an experience that could help them open up and communicate well with others both with and without ASD. A series of training involved aims at an interaction and understanding gestures of others followed by initial training with child himself and animated creature through interaction. This overall experience integrates interactive play and human gestures in the way it happens in the real world. This will train and help enhance their willingness to share, interact and communicate with others besides training the motor skills. The resulting interactive environment addresses communication problem by introduction of a communicative and adaptive medium between a child with ASD and others.

Library of Congress Subject Headings

Autistic children--Language; Autistic children--Means of communication; Autistic children--Services for; Mixed reality

Publication Date


Document Type


Student Type


Degree Name

Industrial Design (MFA)

Department, Program, or Center

School of Design (CAD)


Stan Rickel

Advisor/Committee Member

Mindy Magyar

Advisor/Committee Member

Cha Ron Sattler-Leblanc


RIT – Main Campus

Plan Codes