DrawTalking: Building Interactive Worlds by Sketching and Speaking

DrawTalking is a prototype system that empowers users to build interactive worlds by sketching and speaking while telling stories.

Created by: Karl Toby Rosenberg

Contact: karltobyrosenberg [-at-] nyu [-dot-] edu
Home Page
LinkedIn

Paper (published in HCI Conference ACM UIST 2024):
Conference Program Page, Adobe Research Page

Project Code

Supplemental: User Study: System Manual/Instructions for Participants

Poster:

Short Preview:

Full Demo Reel:

Full-Length Demos (Playlist):