DrawTalking: Building Interactive Worlds by Sketching and Speaking

DrawTalking is a prototype system that empowers users to build interactive worlds by sketching and speaking — while telling stories.

Created by: Karl Toby Rosenberg

Contact: karltobyrosenberg [-at-] nyu [-dot-] edu
LinkedIn

Paper (accepted to HCI Conference ACM UIST 2024):
Conference Program Page, Adobe Research Page

Supplemental: User Study: System Manual/Instructions for Participants

Poster:

Short Preview:

Full Demo Reel:

Full-Length Demos (Playlist):