Past Research
- Past Research
- VR System for Improving Social Skills in Teenagers with Autism
- Robot-mediated Response to Joint Attention System for Children with Autism
- Robotic intervention platform for older adults with mild cognitive impairment and dementia
- Collaborative Virtual Environments
- Social interaction skills tutoring using collaborative Augmented Reality (AR) environment for children with ASD
- Assistive avatar in virtual reality puzzle game to improve eye gaze perception in children with ASD
- Physiology-based Dynamic Difficulty Adjustment Driving Task
- Intelligent Agent
- Physiological Data Processing and Physiology-based Emotion Recognition
- EEG-based Affective Computing
- Cognitive Load Measurement
- IntelliCane: Intelligent Walking Cane System
- Tactile Stimulation Device
- A Haptic Virtual System for Improving Fine Motor Skills in Children with Autism Spectrum Disorders
- Teddy Bear Robot
Personnel:
Dayi Bian, Zhaobo Zheng, Amy Swanson, Amy Weitlauf, Zachary Warren, & Nilanjan Sarkar.
Goals/Objectives:
- Design a multisensory stimulation delivery system to chart out sensory processing differences for infants
Outline:
MADCAP includes three main components: a multisensory stimulation delivery module consisting of audio, visual, and tactile stimuli, a multi-dimensional data capture module capturing a subject’s response, and a supervisory controller module to synchronize the interconnection between the two modules. The audiovisual stimuli delivery module was implemented by using Unity software, it delivers synchronized or asynchronized audiovisual stimuli. The tactile stimulus is delivered by a custom-designed tactile stimulation device (TSD), which is designed specifically for infants to deliver affective touch at precisely controlled brush speed and pressure. TSD communicates and synchronize with audiovisual stimuli through serial port. The Tobii X120 eye tracker is used to record the gaze position and the E4 sensor was used to record the physiological data while worn on the ankle. The following picture is the experimental setup of MADCAP.
Publications:
- D. Bian, Z. Zheng, A. Swanson, A. Weitlauf, Z. Warren, and N. Sarkar, “Design of a Multisensory Stimulus Delivery System for Investigating Response Trajectories in Infancy,” International Conference on Universal Access in Human-Computer Interaction, 2017.