Skip to main content

MOMENTS: Using rich analytics and AI to support reflection and learning during simulation training.

Posted by on Tuesday, July 16, 2024 in Uncategorized.

One of the best ways of helping students learn is to have them experience realistic simulations of the situations they will confront in practice. Simulation learning is particularly important in medical settings where students can practice skills without risking patient safety. However, one of the consistent challenges in simulation learning is to ensure that students can effectively review and learn from experiences that are compelling, but also can be overwhelming. In this project, a multidisciplinary research team will implement technologies that record rich, detailed information about the events that occur during nursing simulations, and that support reflection-based learning by allowing students and simulation instructors to review and elaborate upon simulations events. This project aims both to develop technological supports for simulation training that improve learning by helping students reflect on their experiences, and that can be used as the basis for AI-based scaling of complex simulation training that can increase the accessibility of these intensive experiences.

In this project, we are developing a cognitively grounded system of nursing simulation training supports called MOMENTS (MultimOdal Metacognitive EveNt-based Training for Self-regulation). MOMENTS has several key components. First is Debrief, a module to support same-day learning. Debrief includes a smartphone app that allows both instructors and observing students to mark key moments that happen during enactment of the hospital room scenarios. The app can compute advanced analytics during simulations and make this information available to students and instructors in support of post-simulation debriefing sessions.

Second, we are developing an intensive post-simulation review module called Reflect that can be completed within several weeks of the simulation experience. Reflect induces crucial long-term reactivation of simulation learning experiences and intensive reflection by requiring students to segment their simulation into meaningful events and identify key actions, goals, and cognitive states during each event. This guided reflection is grounded in evidence-based debriefing practices that are currently used in nursing education, but it also leverages multimodal learning analytics to personalize and empower students’ reflection experiences. Finally, our system will be integrated with an AI analytics module to analyze and eventually automate detection of key moments during simulations, and with a multimodal analytics storage and access system that can be operated with a series of data dashboards.

How to Get Involved:

Partners interested in encoding and analyzing action analytics relevant to learning and in developing simulation learning supports in areas that may have requirements similar to nursing simulation.

MOMENTS PI

image_thumb
Dan Levin
Professor, Psychology and Human Development

MOMENTS Personnel

image_thumb
Gautam Biswas
Cornelius Vanderbilt Professor, Engineering
image_thumb
Clayton Cohn
PhD Student, Computer Science
image_thumb
Eduardo Davalos
PhD Student, Computer Science
image_thumb
Alyssa Friend Wise
LIVE Director, Professor of Technology & Education
image_thumb
Mary Ann Jessee
Professor, Nursing
image_thumb
Madison Lee
PhD Student, Psychological Sciences
image_thumb
Fanjie Li
PhD Student, Teaching and Learning
image_thumb
Meiyi Ma
Assistant Professor, Computer Science
image_thumb
Calab Vatral
PhD Student, Computer Science
image_thumb
Hanchen (David) Wang
PhD Student, Computer Science

Core Publications

Lee, M.J., & Levin, D.T. (in press). Temporal flexibility in event perception: A cognitive temporal window supports flexible integration of multimodal events. Journal of Experimental Psychology: General.

Vatral, C., Biswas, G., Cohn, C., Lee, M.J., Davalos, E., Levin, D.T., Hall, E., Holt, J. (2023). A Tale of Two Nurses: Studying Groupwork in Nurse Training by Analyzing Taskwork Roles, Social Interactions, and Self-Efficacy. International Conference on Computer-Supported Collaborative Learning.

Davalos, E., Vatral, C., Cohn, C., Fonteles, J., Biswas, G., Mohammad, N., Lee, M., & Levin, D.T. (2023). Identifying Gaze Behavior Evolution via Temporal Fully-Weighted Scanpath Graphs. 13th International Learning Analytics and Knowledge Conference.

Funding Sources

Tags: ,