Past Research
- Past Research
- VR System for Improving Social Skills in Teenagers with Autism
- Robot-mediated Response to Joint Attention System for Children with Autism
- Robotic intervention platform for older adults with mild cognitive impairment and dementia
- Collaborative Virtual Environments
- Social interaction skills tutoring using collaborative Augmented Reality (AR) environment for children with ASD
- Assistive avatar in virtual reality puzzle game to improve eye gaze perception in children with ASD
- Physiology-based Dynamic Difficulty Adjustment Driving Task
- Intelligent Agent
- Physiological Data Processing and Physiology-based Emotion Recognition
- EEG-based Affective Computing
- Cognitive Load Measurement
- IntelliCane: Intelligent Walking Cane System
- Tactile Stimulation Device
- A Haptic Virtual System for Improving Fine Motor Skills in Children with Autism Spectrum Disorders
- Teddy Bear Robot
Personnel:
Dayi Bian, Joshua Wade, Zachary Warren, & Nilanjan Sarkar.
Goals/Objectives:
- Design a physiology-based dynamic difficulty adjustment driving task to keep the user optimally challenged
Outline:
VR-based skill training systems have demonstrated usefulness for training specific skills in individuals with ASD. However, a simple performance-based system without appropriate feedback to the user may not be optimal for enhancing and optimizing learning. Managing task difficulty to keep the user optimally challenged is crucial for designing an effective skill training system. In this project, random forest algorithm was used to build an engagement prediction model based on the physiological responses (blood volume pulse, skin conductance and respiration) from the users. The model was used to predict the user’s engagement model during the driving task. Then the driving task adjusts its difficulty level based on the user’s performance metrics and engagement level in real time.
Publications:
- D. Bian, J. Wade, A. Swanson, A. Weitlauf, Z. Warren, and N. Sarkar, “Online Engagement Detection and Task Adaptation in a Virtual Reality Based Driving Simulator for Autism Intervention,” International Conference on Universal Access in Human-Computer Interaction, 2016.
- D. Bian, J. Wade, A. Swanson, A. Weitlauf, Z. Warren, and N. Sarkar, “Design of a Physiology-based Dynamic Difficulty Adjustment Virtual Reality Driving Platform and its Application in ASD Intervention,” ACM Transactions on Interactive Intelligent Systems (TiiS), 2017, Under review.