{"id":533,"date":"2024-06-11T19:49:37","date_gmt":"2024-06-11T19:49:37","guid":{"rendered":"https:\/\/lab.prd.vanderbilt.edu\/live\/?p=533"},"modified":"2024-07-29T14:46:30","modified_gmt":"2024-07-29T14:46:30","slug":"understanding-and-leveraging-human-cognition-to-empower-ai-models-for-programming","status":"publish","type":"post","link":"https:\/\/lab.vanderbilt.edu\/live\/2024\/06\/11\/understanding-and-leveraging-human-cognition-to-empower-ai-models-for-programming\/","title":{"rendered":"EyeTrans: Understanding and Leveraging Human Cognition to Empower AI models for Programming"},"content":{"rendered":"
\n
\n
\n
\"\"<\/div>\n
This project uses multi-modalities including eye tracking and medical imaging to model human cognitive processes in programming activities, and then leverage human cognition to develop automated mod<\/span>els and tools to assist automated programming tasks. This series of projects aims to investigate the fundamental cognitive processes in programming and empower the modeling and design of more efficient automated tools for programming tasks and pedagogical purposes.<\/span><\/div>\n<\/div>\n<\/div>\n<\/div>\n
\n
\n
\n
\n

EyeTrans PI<\/h2>
\"image_thumb\"<\/a><\/div>
Yu Huang<\/a><\/strong>
Assistant Professor, Computer Science
<\/div>
<\/i> <\/a><\/div><\/div><\/div><\/div>\n

EyeTrans Personnel<\/h2>
\"image_thumb\"<\/a><\/div>
Zihan Fang<\/a><\/strong>
PhD Student, Computer Science
<\/div>
<\/i> <\/a><\/div><\/div><\/div>
\"image_thumb\"<\/a><\/div>
Zach Karas<\/a><\/strong>
PhD Student, Computer Science
<\/div>
<\/i> <\/a><\/div><\/div><\/div>
\"image_thumb\"<\/a><\/div>
Kevin Leach<\/a><\/strong>
Assistant Professor, Computer Science
<\/div>
<\/i> <\/a><\/div><\/div><\/div>
\"image_thumb\"<\/a><\/div>
Yifan Zhang<\/a><\/strong>
PhD Student, Computer Science
<\/div>
<\/i> <\/a><\/div><\/div><\/div>
<\/a><\/div>
Yueke Zhang<\/a><\/strong>
PhD Student, Computer Science
<\/div>
<\/i> <\/a><\/div><\/div><\/div><\/div>\n

Core Publications<\/h2>\n

Huang, Y., Wang, H., Zheng, X., Li, X., Tang, X., & Zhou, M. (2024). EyeTrans: Analyzing and transforming eye-tracking data in software engineering tasks.<\/span><\/a> Proceedings of the 2024 ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE), 322-334.<\/p>\n

Karas, Y.<\/span><\/span>,\u00a0Bansal<\/span><\/span>, A.,\u00a0Zhang<\/span><\/span>, Y.,\u00a0Li<\/span><\/span>, T.,\u00a0McMillan<\/span><\/span>, C., &\u00a0Huang, Y. (2024).\u00a0<\/span><\/span>A Tale of Two Comprehensions? Analyzing Student Programmer Attention during Code Summarization<\/a>. Proceedings of the 2023 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA ’23). ACM.\u00a0<\/span><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

This project uses multi-modalities including eye tracking and medical imaging to model human cognitive processes in programming activities, and then leverage human cognition to develop automated models and tools to assist automated programming tasks. This series of projects aims to investigate the fundamental cognitive processes in programming and empower the modeling and design of more…<\/p>\n","protected":false},"author":492,"featured_media":777,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_links_to":"","_links_to_target":""},"categories":[1],"tags":[7,91],"class_list":["post-533","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-project","tag-stemeducation"],"acf":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/cdn.vanderbilt.edu\/t2-main\/lab-prd\/wp-content\/uploads\/sites\/211\/2024\/06\/Screenshot-2024-06-24-at-1.01.22-PM-e1721315769343.png","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pfnfAe-8B","_links":{"self":[{"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/posts\/533","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/users\/492"}],"replies":[{"embeddable":true,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/comments?post=533"}],"version-history":[{"count":8,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/posts\/533\/revisions"}],"predecessor-version":[{"id":1146,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/posts\/533\/revisions\/1146"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/media\/777"}],"wp:attachment":[{"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/media?parent=533"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/categories?post=533"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lab.vanderbilt.edu\/live\/wp-json\/wp\/v2\/tags?post=533"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}