Bryan Wang, Ph.D.

Precision Flow

A Firefly image editing feature that renders every edit as a continuous spectrum. Glide a slider from A to B and land anywhere in between.

Generate Soundtrack

A Firefly audio tool that generates commercially-safe instrumental soundtracks from a text prompt or video. Music that fits your footage, automatically.

Dramarrator: Object-Based Audio Editing for Audio Drama Production from Books

Karim Benharrak, Oriol Nieto, Bryan Wang, Zeyu Jin, Amy Pavel

Sidekick: Designing Ambient Communication for Effective Multitasking with Computer Use Agents

Ruei-Che Chang, Wenqian Xu, Ding Li, Bryan Wang, Anhong Guo

Vidmento: Creating Video Stories Through Context-Aware Expansion With Generative Video

Catherine Yeh, Anh Truong, Mira Dontcheva, Bryan Wang

VidTune: Creating Video Soundtracks with Generative Music and Contextual Thumbnails

Mina Huh, Ailie C. Fraser, Dingzeyu Li, Mira Dontcheva, Bryan Wang

Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation

Zhecheng Wang, Jiaju Ma, Eitan Grinspun, Tovi Grossman, Bryan Wang

MapStory: Prototyping Editable Map Animations with LLM Agents

Aditya Gunturu, Ben Pearman, Keiichi Ihara, Morteza Faraji, Bryan Wang, Rubaiat Habib Kazi, Ryo Suzuki

SimTube: Generating Simulated Video Comments through Multimodal AI and User Personas

Yu-Kai Hung, Yun-Chien Huang, Ting-Yu Su, Yen-Ting Lin, Lung-Pan Cheng, Bryan Wang*, Shao-Hua Sun* (∗Equal advisory contribution.)

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions

Hsin-Ruey Tsai, Shih-Kang Chiu, Bryan Wang

KnowledgeTrail: Generative Timeline for Exploration and Sensemaking of Historical Events and Knowledge Formation

Sangho Suh, Rahul Hingorani, Bryan Wang, Tovi Grossman

Human-AI Systems for Creating, Consuming, and Interacting with Digital Content

Bryan Wang

LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing

Bryan Wang, Yuliang Li, Zhaoyang Lv, Haijun Xia, Yan Xu, Raj Sodhi

SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration

Stephen Brade, Bryan Wang, Mauricio Sousa, Gregory Lee Newsome, Sageev Oore, Tovi Grossman

Also appeared at NeurIPS 2023 Workshop on Machine Learning for Creativity and Design.

Flowy: Supporting UX Design Decisions Through AI-Driven Pattern Annotation in Multi-Screen User Flows

Yuwen Lu, Ziang Tong, Qinyi Zhao, Yewon Oh, Bryan Wang, Toby Jia-Jun Li

A Zero-Shot Language Agent for Computer Control with Structured Reflection

Tao Li, Gang Li, Zhiwei Deng, Bryan Wang, Yang Li

Democratizing Content Creation and Consumption through Human-AI Copilot Systems

Bryan Wang

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models

Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, Tovi Grossman

Enabling Conversational Interaction with Mobile UI using Large Language Models

Bryan Wang, Gang Li, Yang Li

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Jiannan Li, Mauricio Sousa, Bryan Wang, Paula Akemi Aoyagui, Nicole Yu, Angela Yang, Ravin Balakrishnan, Anthony Tang, Tovi Grossman

Creepy Assistant: Development and Validation of a Scale to Measure the Perceived Creepiness of Voice Assistants

Rachel Phinnemore, Mohi Reza, Blaine Lewis, Karthik Mahadevan, Bryan Wang, Michelle Annett, Daniel Wigdor

Record Once, Post Everywhere: Automatic Shortening of Audio Stories for Social Media

Bryan Wang, Zeyu Jin, Gautham Mysore

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

Bryan Wang, Meng Yu Yang, Tovi Grossman

AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

Zhuoyue Lyu, Jiannan Li, Bryan Wang

BlyncSync: Enabling Multimodal Smartwatch Gestures with Synchronous Touch and Blink

Bryan Wang, Tovi Grossman

PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network

Bryan Wang, Yi-Hsuan Yang

Demonstration of PerformanceNet: A Convolutional Neural Network Model for Score-to-Audio Music Generation

Yu-Hua Chen, Bryan Wang, Yi-Hsuan Yang

ActiveErgo: Automatic and Personalized Ergonomics Using Self-Actuating Furniture

Yu-Chian Wu, Te-Yen Wu, Paul Taele, Bryan Wang, Jun-You Liu, Pin-Sung Ku, Po-En Lai, Mike Y. Chen

CircuitSense: Automatic Sensing of Physical Circuits and Generation of Virtual Circuits to Support Software Tools

Te-Yen Wu, Bryan Wang, Jiun-Yu Lee, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-Sung Ku, Ming-Wei Hsu, Yu-Chih Lin, Mike Y. Chen

CircuitStack: Supporting Rapid Prototyping and Evolution of Electronic Circuits

Chiuan Wang, Hsuan-Ming Yeh, Bryan Wang, Te-Yen Wu, Hsin-Ruey Tsai, Rong-Hao Liang, Yi-Ping Hung, Mike Y. Chen