CursorTalk: Multimodal, Spatio-Temporal Inputs for AI-assisted Web UI Editing
Designers edit web UIs by speaking while pointing; CursorTalk resolves deictic words such as "this" and "here" against the cursor trajectory as they are spoken.
ResearchCube: Multi-Dimensional Trade-off Exploration for Research Ideation
Can AI Prompt Humans? Multimodal Agents Prompt Players' Game Design Ideas
Multimodal agents that prompt players to generate game design ideas, exploring whether AI can effectively prompt humans.
Can AI Prompt Humans? Multimodal Agents Prompt Players' Game Design Ideas
Presentation at CHI 2025 on multimodal agents prompting human game design ideas.
me
Intent-AI Interaction: Elevating Human-Computer Interaction to the Intent and Conceptual Level
Invited talk at UMD Human-Computer Interaction Lab presenting research vision on Intent-AI Interaction.
me
Intent-AI Interaction
Elevating Human-Computer Interaction to the intent and conceptual level, enabling users to communicate goals rather than low-level commands to AI systems.
•
1 min read
Harnessing the Power of LLMs: Evaluating Human-AI Interaction through the Lens of News Headline Generation
Evaluating human-AI interaction with LLMs through the task of news headline generation.