Skip to main content

Multimodal Job Interview Simulator for Training of Autistic Individuals


AUTHORS

Adiani Deeksha , Breen Michael , Migovich Miroslava , Wade Joshua , Hunt Spencer , Tauseef Mahrukh , Khan Nibraas , Colopietro Kelley , Lanthier Megan , Swanson Amy , Vogus Timothy J. , Sarkar Nilanjan . Assistive Technology . 2023 3 31; ().

ABSTRACT

Full Text: Multimodal-job-interview-simulator-for-training-of-autistic-individuals

Autistic individuals face difficulties in finding and maintaining employment, and studies have shown that the job interview is often a significant barrier to obtaining employment. Prior computer-based job interview training interventions for autistic individuals have been associated with better interview outcomes. These previous interventions, however, do not leverage the use of multimodal data that could give insight into the emotional underpinnings of autistic individuals’ challenges in job interviews. In this article, the authors present the design of a novel multimodal job interview training platform called CIRVR that simulates job interviews through spoken interaction and collects eye gaze, facial expressions, and physiological responses of the participants to understand their stress response and their affective state. Results from a feasibility study with 23 autistic participants who interacted with CIRVR are presented. In addition, qualitative feedback was gathered from stakeholders on visualizations of data on CIRVR’s visualization tool called the Dashboard. The data gathered indicate the potential of CIRVR along with the Dashboard to be used in the creation of individualized job interview training of autistic individuals.