CursorTalk: Multimodal, Spatio-Temporal Inputs for AI-assisted Web UI Editing
Designers edit web UIs by speaking while pointing; CursorTalk resolves deictic words such as "this" and "here" against the cursor trajectory as they are spoken.
Koichiro Niinuma