Past Research
- Past Research
- VR System for Improving Social Skills in Teenagers with Autism
- Robot-mediated Response to Joint Attention System for Children with Autism
- Robotic intervention platform for older adults with mild cognitive impairment and dementia
- Collaborative Virtual Environments
- Social interaction skills tutoring using collaborative Augmented Reality (AR) environment for children with ASD
- Assistive avatar in virtual reality puzzle game to improve eye gaze perception in children with ASD
- Physiology-based Dynamic Difficulty Adjustment Driving Task
- Intelligent Agent
- Physiological Data Processing and Physiology-based Emotion Recognition
- EEG-based Affective Computing
- Cognitive Load Measurement
- IntelliCane: Intelligent Walking Cane System
- Tactile Stimulation Device
- A Haptic Virtual System for Improving Fine Motor Skills in Children with Autism Spectrum Disorders
- Teddy Bear Robot
Personnel:
Esube Bekele, Joshua Wade, Dayi Bian, Lian Zhang, Jing Fan
Outline:
We are designing a novel VR-based social task training system for teenagers with autism. The system will allow a participant to interact with virtual avatars in a social scene (e.g., a school cafeteria) to first identify deficits and then provide training to improve them. The system assesses real-time measurement of performance and cognitive data to provide individualized interaction.
Another project focusing on emotion recognition using virtual reality was featured on ABC News and Ivanhoe News.
Publications:
- Bekele, E., Wade, J., Bian, D., Fan, J., Swanson, A., Warren, Z., & Sarkar, N. (2016, March). Multimodal adaptive social interaction in virtual environment (MASI-VR) for children with Autism spectrum disorders (ASD). In Virtual Reality (VR), 2016 IEEE (pp. 121-130). IEEE.
- Bekele, E., Wade, J. W., Bian, D., Zhang, L., Zheng, Z., Swanson, A., … & Sarkar, N. (2014, June). Multimodal Interfaces and Sensory Fusion in VR for Social Interactions. In International Conference on Virtual, Augmented and Mixed Reality (pp. 14-24). Springer International Publishing.
- Peterman, J. S., Bekele, E., Bian, D., Sarkar, N., & Park, S. (2015). Complexities of emotional responses to social and non-social affective stimuli in schizophrenia. Frontiers in psychology, 6.
- Bekele, E., Crittendon, J., Zheng, Z., Swanson, A., Weitlauf, A., Warren, Z., & Sarkar, N. (2014). Assessing the utility of a virtual environment for enhancing facial affect recognition in adolescents with autism. Journal of autism and developmental disorders, 44(7), 1641-1650.
- Bekele, E., Bian, D., Zheng, Z., Peterman, J., Park, S., & Sarkar, N. (2014, June). Responses during facial emotional expression recognition tasks using virtual reality and static iaps pictures for adults with schizophrenia. In International Conference on Virtual, Augmented and Mixed Reality (pp. 225-235). Springer International Publishing.
- Bekele, E., Young, M., Zheng, Z., Zhang, L., Swanson, A., Johnston, R., … & Sarkar, N. (2013, July). A step towards adaptive multimodal virtual social interaction platform for children with autism. In International Conference on Universal Access in Human-Computer Interaction (pp. 464-473). Springer Berlin Heidelberg.
- Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., & Sarkar, N. (2013). Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE transactions on visualization and computer graphics, 19(4), 711-720.