David Chuan-En Lin
chuanenl [at] cs.cmu.edu
Hi there 👋. I am currently a fourth-year Computer Science Ph.D. student at Carnegie Mellon University. I work with Professor Nik Martelaro in the Augmented Design Capability Studio. I did internships at
Adobe Research and
Runway. My research is also supported by
Toyota Research Institute and
Accenture Labs.
Research Interest
My main research interest focuses on steering tools for generative AI design. To explore this space, I have developed a sketching interface (Inkspire), a puzzle-like interface (Jigsaw), and a latent space map interface (VideoMap).
Another thread of my research is on AI-assisted video creation tools, including tools for matching sounds to visuals (Soundify), detecting highlight moments (Videogenic), and organizing video assets (VideoMap).
Papers
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Assembling AI Foundation Models
David Chuan-En Lin, Nikolas Martelaro
We developed a tool for combining AI models across different capabilities and modalities by assembling them like puzzle pieces.
VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro
We developed a proof-of-concept video editing interface that operates on video frames projected onto a latent space.
Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior
David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro
We developed a system for detecting highlight moments by leveraging photographs taken by photographers.
Soundify: Matching Sound Effects to Video
David Chuan-En Lin, Anastasis Germanidis, Cristóbal Valenzuela, Yining Shi, Nikolas Martelaro
We developed a system to assist video editors in adding content-aware spatial sound effects to video.
Learning Personal Style from Few Examples
David Chuan-En Lin, Nikolas Martelaro
We developed a model for learning personal graphic design style from a handful of examples.
ARchitect: Building Interactive Virtual Experiences from Physical Affordances by Bringing Human-in-the-Loop
Chuan-En Lin*, Ta Ying Cheng*, Xiaojuan Ma(*=equal contribution)
We explored an asymmetric workflow of an AR builder and a VR player for creating VR experiences that incorporate real-world interaction affordances.
SeqDynamics: Visual Analytics for Evaluating Online Problem-solving Dynamics
Meng Xia, Min Xu, Chuan-En Lin, Ta Ying Cheng, Huamin Qu, Xiaojuan Ma
We developed an interactive visual analytics system for instructors to evaluate problem-solving dynamics of student learners.
Service
Conference reviewer
- ACM Conference on Human Factors in Computing Systems: 2023, 2024
Other Projects
Last updated on Apr 2024.