Bridging Human Intent and Generative AI: Alignment, Articulation, and Adaptation

Generative AI (GenAI) has become an indispensable collaborator in various domains and reshaped how humans accomplish diverse tasks, ranging from data analysis to content creation. However, the current human- GenAI interaction loop faces three fundamental breakdowns: 1) the Instruction Gap, where users struggle to express complex and abstract intent with low-bandwidth prompts, 2) the Interpretation Gap, where GenAI misinterprets prompts and humans misinterpret responses, and 3) the Inference Gap, where GenAI outputs generic responses due to its blindness to implicit intent. In this talk, I will present a unified framework of Articulation, Alignment, and Adaptation that addresses the above gaps. Specifically, I will share how my work empowers users to articulate complex intent with expressive prompts, align hidden AI logic with dynamic intent, and adapt AI responses to implicit intent. I will showcase how the framework can be applied to various tasks, ranging from problem-solving wi th programming to computational design for concept videos, character animation, motion graphics, particle effects, and color design.
Linping YUAN is a research assistant professor in the Department of Computer Science and Engineering (CSE) at the Hong Kong University of Science and Technology (HKUST). Her research interests lie in the intersection of virtual/augmented reality (VR/AR), human-computer interaction (HCI), and data visualization (VIS). She designs and develops algorithms, interactive tools, and visual analytic systems to facilitate the creation of various artifacts, including 2D visualizations and infographics, AR data videos, and VR animated stories. She also develops human-centered applications for various domains, such as education, healthcare, and tourism. Her work has been published at top-tier HCI and computer graphics venues, including IEEE TVCG, IEEE VR, ACM CHI, ACM UIST, IJHCS, etc. Her research has also made real-world impacts, such as becoming a part of a public exhibition at HKUST Library, empowering a mobile application of a global public speaking training company, and improving the pu blic service delivery of a local government.