Past Research
- Past Research
- VR System for Improving Social Skills in Teenagers with Autism
- Robot-mediated Response to Joint Attention System for Children with Autism
- Robotic intervention platform for older adults with mild cognitive impairment and dementia
- Collaborative Virtual Environments
- Social interaction skills tutoring using collaborative Augmented Reality (AR) environment for children with ASD
- Assistive avatar in virtual reality puzzle game to improve eye gaze perception in children with ASD
- Physiology-based Dynamic Difficulty Adjustment Driving Task
- Intelligent Agent
- Physiological Data Processing and Physiology-based Emotion Recognition
- EEG-based Affective Computing
- Cognitive Load Measurement
- IntelliCane: Intelligent Walking Cane System
- Tactile Stimulation Device
- A Haptic Virtual System for Improving Fine Motor Skills in Children with Autism Spectrum Disorders
- Teddy Bear Robot
Personnel:
Ashwaq Amat, Huan Zhao, Amy Swanson, Amy Weitlauf, Zachary Warren, & Nilanjan Sarkar.
Goals/Objectives:
- Design an eye gaze-based interactive puzzle game for children with ASD
- Design of a virtual puzzle game that is capable of capturing eye gaze data and tracking children’s performance in real-time during game play
- Design of an assistive avatar that is capable of providing non-verbal gaze cues to the children when they are playing the puzzle game
- Design of an assistive avatar that is capable of providing cues and hints based on children performance and when children are unable to respond to gaze cues
Outline:
Gaze sharing plays an important role in children’s early learning and social development. Children diagnosed with ASD and at risk have been known to show diminished eye contact and altered gaze. A virtual reality-based puzzle game was designed for children with ASD to be more aware of gaze cues and improve their ability to interpret these cues. The VR game used finite state machines (FSMs) to control the game sequence. An assistive avatar was designed as a playing partner to provide the children with gaze cues on which puzzle piece to move. The VR game was also designed to use the performance data and gaze data in real-time for the avatar to provide hints and assistance to the children if they were unable to progress during the game play.
Publications:
- AZ Amat, A Swanson, A Weitlauf, Z Warren, N Sarkar, “Design of an Assistive Avatar in Improving Eye Gaze Perception in Children with ASD During Virtual Interaction“, International Conference on Universal Access in Human-Computer Interaction, 463-474