Skip to main content

LIVE Learning Innovation Incubator

EyeTrans: Understanding and Leveraging Human Cognition to Empower AI models for Programming

Posted by on Tuesday, June 11, 2024 in Uncategorized.

This project uses multi-modalities including eye tracking and medical imaging to model human cognitive processes in programming activities, and then leverage human cognition to develop automated models and tools to assist automated programming tasks. This series of projects aims to investigate the fundamental cognitive processes in programming and empower the modeling and design of more efficient automated tools for programming tasks and pedagogical purposes.

EyeTrans PI

image_thumb
Yu Huang
Assistant Professor, Computer Science

EyeTrans Personnel

image_thumb
Zihan Fang
PhD Student, Computer Science
image_thumb
Zach Karas
PhD Student, Computer Science
image_thumb
Kevin Leach
Assistant Professor, Computer Science
image_thumb
Yifan Zhang
PhD Student, Computer Science
Yueke Zhang
PhD Student, Computer Science

Core Publications

Huang, Y., Wang, H., Zheng, X., Li, X., Tang, X., & Zhou, M. (2024). EyeTrans: Analyzing and transforming eye-tracking data in software engineering tasks. Proceedings of the 2024 ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 322-334.

Karas, Y., Bansal, A., Zhang, Y., Li, T., McMillan, C., & Huang, Y. (2024). A Tale of Two Comprehensions? Analyzing Student Programmer Attention during Code Summarization. Proceedings of the 2023 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA ’23). ACM. 

Tags: ,