Yuanzhen Li

At Google Research, I support a talented team and a few cross-team Computer Vision and Generative AI efforts. Recent work includes: Generative Product Imagery, "Imagen" in Google Cloud Vertex AI, Muse, DreamBooth, DreamBooth3D, Generative Uncrop, etc.

Prior to Google, I spent 10 years in the startup world. I made iPhone computational-photography apps, and one of them (TrueHDR) was quite popular in the 2009-2012 era. I also founded a startup leveraging deep learning for image search; it was acquired by VSCO in 2015 and I then worked at VSCO as a Director of Engineering.

Prior to that, I completed my PhD in 2009 at MIT with Prof. Edward H. Adelson. At MIT, I was a member of the Computer Science and Artificial Intelligence Laboratory (CSAIL) and the Perceptual Science Laboratory.

Email: yzli@csail.mit.edu

   
   
Some Projects
 

DreamBooth3D: Subject-Driven Text-to-3D Generation
Amit Raj, Srinivas Kaza, Ben Poole, Michael Niemeyer, Nataniel Ruiz, Ben Mildenhall, Shiran Zada, Kfir Aberman, Michael Rubinstein, Jonathan T. Barron, Yuanzhen Li, Varun Jampani
March 2023, Paper, Webpage

 

Muse: Text-To-Image Generation via Masked Generative Transformers
Huiwen Chang, Han Zhang, Jarred Barber, AJ Maschinot, Jose Lezama, Lu Jiang, Ming-Hsuan Yang, Kevin Murphy, William T. Freeman, Michael Rubinstein, Yuanzhen Li, Dilip Krishnan
January 2023, Paper, Webpage

 

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, Kfir Aberman
August 2022, Paper, Webpage

 

Simplified Transfer Learning for Chest Radiography Models Using Less Data
Andrew B. Sellergren, Christina Chen, Zaid Nabulsi, Yuanzhen Li, Aaron Maschinot, Aaron Sarna, Jenny Huang, Charles Lau, Sreenivasa Raju Kalidindi, Mozziyar Etemadi, Florencia Garcia-Vicente, David Melnick, Yun Liu, Krish Eswaran, Daniel Tse, Neeral Beladia, Dilip Krishnan, Shravya Shetty
Radiology. 2022, Paper, Blog, Tweet

 

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections
Mark Boss, Andreas Engelhardt, Abhishek Kar, Yuanzhen Li, Deqing Sun, Jonathan T. Barron, Hendrik P. A. Lensch, Varun Jampani
2022, Paper, Video

 

LASSIE: Learning Articulated Shape from Sparse Image Ensemble via 3D Part Discovery
Chun-Han Yao, Wei-Chih Hung, Yuanzhen Li, Michael Rubinstein, Ming-Hsuan Yang, Varun Jampani
2022, Paper, Video, Supplemental


 

Ads Image Uncropping, Blog

 

Automated Designs for Responsive Display Ads, Blog, Patent

 

ScribbleBoost: Adding Classification to Edge-Aware Interpolation of Local Image and Video Adjustments
Yuanzhen Li, Edward H. Adelson, Aseem Agarwala
Graphics Forum, Proceedings of Eurographics Symposium on Rendering 2008

Paper
Video
Supplemental material: User Study

 
im_map.htm

Image Mapping Using Local and Global Statistics
Yuanzhen Li, Edward H. Adelson
Human Vision and Electronic Imaging XIII, Proc. of SPIE-IS&T Electronic Imaging, SPIE Vol. 6806, 2008

 

Image Statistics for Surface Reflectance Perception
Lavanya Sharan, Yuanzhen Li, Isamu Motoyoshi, Shin'ya Nishida, Edward H. Adelson
Journal of the Optical Society of America A, 25(4): 846-865, 2008

 
Measuring Visual Clutter
Ruth Rosenholtz, Yuanzhen Li, Lisa Nakano.
Journal of Vision, 7(2):17, 1-22, 2007

 
scribbleboost

Compressing and Companding High Dynamic Range Images with Subband Architectures.
Yuanzhen Li, Lavanya Sharan, Edward H. Adelson.
SIGGRAPH 2005

Download the doll picture (the hdr version of the image on the left).

 

 
Removing Photography Artifacts using Gradient Projection and Flash-Exposure Sampling.
Amit Agrawal, Ramesh Raskar, Shree K. Nayar, Yuanzhen Li.
SIGGRAPH 2005

 

Feature Congestion: A Measure of Display Clutter.
Ruth Rosenholtz, Yuanzhen Li, Jonathan Mansfield, Zhenlan Jin.
SIGCHI 2005

Download matlab code for generating color and contrast "clutter maps".

 

 

Multiple-cue Illumination Estimation in Textured Scenes. (pdf)
Yuanzhen Li, Stephen Lin, Hanqing Lu, Heung-Yeung Shum.
ICCV 2003.

 

 

Diffuse-Specular Separation and Depth Recovery from Image Sequences. (pdf)
Stephen Lin, Yuanzhen Li, Sing Bing Kang, Xin Tong, Heung-Yeung Shum.
ECCV 2002

 

Multibaseline Stereo in the Presence of Specular Reflections. (pdf)
Yuanzhen Li, Stephen Lin, Hanqing Lu, Sing Bing Kang, Heung-Yeung Shum.
ICPR 2002.

 

Single-Image Reflectance Estimation for Relighting by Iterative Soft Grouping. (pdf)
Yuanzhen Li, Stephen Lin, Sing Bing Kang, Hanqing Lu and Heung-Yeung Shum.
Pacific Graphics 2002.