Ce Liu

IEEE Fellow

AI Research Scientist Director

Meta GenAI

Email: celiuxkxkxk@meta.com

Services

Area Chairs for ICCV 2023, CVPR 2023, ICLR 2023, NeurIPS 2022, ICLR 2022, ICLR 2021, ICML 2021, ICCV 2021, and NeurIPS 2021

Associate Editor for IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020~2022

Program Co-Chair for CVPR 2020

Area Chairs for NeurIPS 2020, NeurIPS 2019, CVPR 2019, NeurIPS 2018, ECCV 2018, CVPR 2017, ICCV 2015.

Co-organized Tutorial on Dense Image Correspondences for Computer Vision at ICCV 2013 and at CVPR 2014

Workershop Chair for CVPR 2013

Publications

2023
	J. Wang, Z. Yang, X. Hu, L. Li, K. Lin, Z. Gan, Z. Liu, C. Liu and L. Wang. GIT: A Generative Image-to-text Transformer for Vision and Language. Transactions on Machine Learning Research (TMLR). Jan, 2023. [pdf]
2022
	S. Shen, C. Li, X. Hu, Y. Xie, J. Yang, P. Zhang, Z. Gan, L. Wang, L. Yuan, C. Liu, K. Keutzer, T. Darrell, A. Rohrbach and J. Gao. K-LITE: Learning Transferable Visual Models with External Knowledge. NeurIPS 2022. [arXiv]
	Y. Xie, L. Zhou, X. Dai, L. Yuan, N. Bach, C. Liu and M. Zeng. Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioninge. NeurIPS 2022. [arXiv]
	Z. Dou, A. Kamath, Z. Gan, P. Zhang, J. Wang, L. Li, Z. Liu, C. Liu, Y. LeCun, N. Peng, J. Gao and L. Wang. Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone. NeurIPS 2022. [arXiv]
	J. Wang, D. Chen, Z. Wu, C. Luo, L. Zhou, Y. Zhao, Y. Xie, C. Liu, Y. Jiang, L. Yuan. OmniVL: One Foundation Model for Image-Language and Video-Language Tasks. NeurIPS 2022. [arXiv]
	H. Chang, H. Zhang, L. Jiang, C. Liu and W. T. Freeman. MaskGIT: Masked Generative Image Transformer. CVPR 2022. [pdf]
	C. Herrmann, K. Sargent, L. Jiang, R. Zabith, H. Chang, C. Liu, D. Krishnan, D. Sun. Pyramid Adversarial Training Improves ViT Performance. CVPR 2022. [pdf]
	I. Yoo, H. Chang, X, Luo, O. Stava, C. Liu, P. Milanfar, F. Yang. Deep 3D-to-2D Watermarking: Embedding Messages in 3D Meshes and Extracting Them from 2D Renderings. CVPR 2022. [pdf]
	J. Yang, C. Li, P. Zhang, B. Xiao, C. Liu, L. Yuan and J. Gao. Unified Contrastive Learning in Image-Text-Label Space. CVPR 2022. [pdf]
2021
	L. Yuan et al. Florence: A New Foundation Model for Computer Vision. Project Florence, 2021. [arXiv]
	M. Boss, V. Jampani, R. Braun, C. Liu, J. T. Barron, H. Lensch. Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition. NeurIPS 2021. [pdf]
	G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, C. Liu, D. Ramanan. ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction. NeurIPS 2021. [pdf]
	V. Jampani, H. Chang, K. Sargent, A. Kar, R. Tucker, M. Krainin, D. Kaeser, W.T. Freeman, D. Salesin, B. Curless and C. Liu. SLIDE: Single Image 3D Photography With Soft Layering and Depth-Aware Inpainting. International Conference on Computer Vision (ICCV) 2021. Oral presentation. [pdf]
	M. Boss, R. Braun, V. Jampani, J. T. Barron, C. Liu, H. Lensch NeRD: Neural Reflectance Decomposition from Image Collections. International Conference on Computer Vision (ICCV) 2021. [pdf]
	Y. Li, P. Jin, F. Yang, C. Liu, M.-H. Yang, P. Milanfar. COMISR: Compression-Informed Video Super-Resolution. International Conference on Computer Vision (ICCV) 2021. Oral presentation. [pdf]
	D. Sun, D. Vlasic, C. Herrmann, V. Jampani, M. Krainin, H. Chang, R. Zabih, W.T. Freeman and C. Liu. AutoFlow: Learning a Better Training Set for Optical Flow. Computer Vision and Pattern Recognition (CVPR) 2021. Oral presentation. [pdf]
	G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, H. Chang, D. Ramanan, W.T. Freeman and C. Liu. LASR: Learning Articulated Shape Reconstruction from a Monocular Video. Computer Vision and Pattern Recognition (CVPR) 2021. [pdf]
	H. Tseng, L. Jiang. C. Liu, M.H. Yang, and W. Yang. Regularizing Generative Adversarial Networks under Limited Data. Computer Vision and Pattern Recognition (CVPR) 2021. [pdf]
	R.S. Bowen, H. Chang, C. Herrmann, P. Teterwak, C. Liu and R. Zabih. OCONet: Image Extrapolation by Object Completion. Computer Vision and Pattern Recognition (CVPR) 2021. [pdf]
2015~2020
	P. Khosla, P. Teterwak, C. Wang, A. Sarna, Y. Tian, P. Isola, A. Maschinot, C. Liu, D. Krishnan. Supervised Contrastive Learning. Advances in Neural Information Processing Systems (NeurIPS) 2020. [pdf] [GitHub]
	Z. Li, T. Dekel, F. Cole, R. Tucker, N. Snavely, C. Liu and W.T. Freeman. MannequinChallenge: Learning the Depths of Moving People by Watching Frozen People. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2020. [pdf]
	P. Teterwak, A. Sarna, D. Krishnan, A. Maschinot, D. Belanger, C. Liu and W. T. Freeman. Boundless: Generative Adversarial Networks for Image Extension. IEEE/CVF International Conference on Computer Vision (ICCV) 2019. [pdf] [GitHub]
	Z. Li, T. Dekel, F. Cole, R. Tucker, N. Snavely, C. Liu and W.T. Freeman. Learning the depths of moving people by watching frozen people. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2019. Oral presentation. Best paper honorable mention. [pdf] [GitHub] [YouTube]
	C. Herrmann, C. Wang, R.S. Bowen, E. Keyder, M. Krainin, C Liu and R. Zabih. Robust Image Stitching with Multiple Registrations. European Conference on Computer Vision (ECCV) 2018. [pdf] [GitHub] [YouTube]
	T. Dekel, C. Gan, D. Krishnan, C. Liu and W.T. Freeman. Smart, Sparse Contours to Represent and Edit Images. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018. [pdf] [GitHub] [YouTube]
	T. Dekel, M. Rubinstein, C. Liu and W.T. Freeman. On the effectiveness of visible watermarks. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017. [pdf] [Google Research Blog]
	M. Rubinstein, C. Liu and W.T. Freeman. Joint Inference in Weakly-Annotated Image Datasets via Dense Correspondence. International Journal of Computer Vision (IJCV) 2016. [pdf]
	T. Xue, M. Rubinstein, C. Liu and W.T. Freeman. A Computational Approach for Obstruction-Free Photography. ACM SIGGRAPH, 2015. [pdf] [YouTube]
2010~2014
	D. Wei, C. Liu and W.T. Freeman. A Data-Driven Regularization Model for Stereo and Flow. 3DV 2014. [pdf]
	L. Xu, J. Ren, C. Liu and J. Jia. Deep Convolutional Neural Network for Image Deconvolution. Neural Information Processing Systems (NIPS), 2014. [pdf]
	K. Karsch, C. Liu and S. B. Kang. DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), pp. 2144-2158, Vol. 36, No. 11, 2014. [project] [pdf]
	D. Sun, C. Liu and H. Pfister. Local Layering for Joint Motion Estimation and Occlusion Detection. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. Oral presentation. [pdf]
	H. Mobahi, C. Liu and W.T. Freeman. A Compositional Model for Low-Dimensional Image Set Representation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. [pdf] [Video MP4 (57MB)]
	C. Liu and D. Sun. On Bayesian Adaptive Video Super Resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), pp. 346-360, Vol. 36, Issue 2, 2014. [pdf]
	P. Isola and C. Liu. Scene Collaging: Analysis and Synthesis of Natural Images With Semantic Layers. International Conference on Computer Vision (ICCV) 2013. [pdf][supplementary]
	L. Sharan, C. Liu, R. Rosenholtz and E. Adelson. Recognizing Materials Using Perceptually Inspired Features. International Journal of Computer Vision (IJCV), pp. 348-371, Vol. 103, Issue 3, July 2013. [pdf]
	X.-J. Wang, L. Zhang, and C. Liu. Duplicate Discovery on 2 Billion Internet Images. In Proceedings of Big Data Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2013. [pdf]
	M. Rubinstein, A. Joulin, J. Kopf and C. Liu. Unsupervised Joint Object Discovery and Segmentation in Internet Images. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2013. [pdf] [webpage]
	J. Kim, C. Liu, F. Sha and K. Grauman. Deformable Spatial Pyramid Matching for Fast Dense Correspondences. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2013. [pdf]
	B. Liu, F. Sadeghi, M. Tappen, O. Shamir and C. Liu. Probabilistic Label Trees for Efficient Large Scale Image Classification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2013. [pdf]
	X.-J. Wang, Z. Xu, L. Zhang, C. Liu and Y. Rui. Towards Indexing Representative Images on the Web. ACM International Conference on Multimedia (ACM MM), 2012. [pdf]
	M. Rubinstein, C. Liu and W.T. Freeman. Annotation Propagation: Automatic Annotation of Large Image Databases via Dense Image Correspondence. European Conference on Computer Vision (ECCV), 2012. [pdf] Supplemental materials [coming soon!]
	K. Karsch, C. Liu and S.B. Kang. Depth Extraction from Video Using Non-parametric Sampling. European Conference on Computer Vision (ECCV), 2012. Oral presentation. [pdf] [code & data]
	M. Tappen and C. Liu. A Bayesian Approach to Alignment-based Image Hallucination. European Conference on Computer Vision (ECCV), 2012. [pdf]
	D. Sun and C. Liu. Non-causal Temporal Prior for Video Deblocking. European Conference on Computer Vision (ECCV), 2012. [pdf]
	M. Rubinstein, C. Liu and W.T. Freeman. Towards Longer Long-Range Motion Trajectories. British Machine Vision Conference (BMVC), 2012. [pdf]
	J. Yuen, C. L. Zitnick, C. Liu, and A. Torralba. A framework for encoding object-level image priors. Microsoft Research Technical Report, MSR-TR-2011-99, 2011. [pdf]
	O. Tamuz, C. Liu, S. Belongie, O. Shamir and A. Kalai. Adaptively Learning the Crowd Kernel. 28th International Conference on Machine Learning (ICML), 2011. [pdf]
	C. Liu and D. Sun. A Bayesian Approach to Adaptive Video Super Resolution. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011. Oral presentation. [pdf][webpage]
	M. Rubinstein, C. Liu, P. Sand, F. Durand, W.T. Freeman. Motion Denoising with Application to Time-lapse Photography. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011. [pdf] [webpage]
	C. Liu, J. Yuen and A. Torralba. Nonparametric Scene Parsing via Label Transfer. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol 33, No. 12, 2011. [pdf] [webpage] [code & data]
	C. Liu, J. Yuen and A. Torralba. SIFT flow: dense correspondence across different scenes and its applications. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol 33, No.5, 2011. [pdf] [webpage]
	C. Liu and William T. Freeman. A High-Quality Video Denoising Algorithm based on Reliable Motion Estimation. European Conference on Computer Vision (ECCV) 2010. Oral presentation. [pdf] [webpage]
	C. Liu, L. Sharan, E. H. Adelson and R. Rosenholtz. Exploring features in a Bayesian framework for material recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2010. [pdf] [webpage]
2001~2010
	J. Yuen, B. Russell, C. Liu and A. Torralba. LabelMe video: Building a Video Database with Human Annotations. IEEE International Conference on Computer Vision (ICCV), Oct 2009. [pdf]
	C. Liu. Beyond pixels: exploring new representations and applications for motion analysis. Doctoral Thesis. Massachusetts Institute of Technology. May 2009. [pdf]
	C. Liu, J. Yuen, and A. Torralba. Nonparametric scene parsing: label transfer via dense scene alignment. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2009. Oral presentation. Best Student Paper Award [pdf] [ppt] [webpage] [code & data]
	C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman. SIFT flow: dense correspondence across different scenes. European Conference on Computer Vision (ECCV) 2008. Oral presentation. [webpage] [pdf].
	C. Liu, W. T. Freeman, E. H. Adelson and Y. Weiss. Human-assisted motion annotation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2008. Oral presentation. [pdf] [webpage].
	C. Liu, R. Szeliski, S. B. Kang, C. L. Zitnick and W. T. Freeman. Automatic estimation and removal of noise from a single image. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol 30, No. 2, pp. 299-314, Feb., 2008. [pdf] [MSR TR link]
	B. Russell, A. Torralba, C. Liu, R. Fergus and W. T. Freeman. Object recognition by scene alignment. Advances in Neural Information Processing Systems (NIPS), 2007. [pdf] [webpage]
	C. Liu, H. Y. Shum and W. T. Freeman. Face hallucination: theory and practice. International Journal of Computer Vision (IJCV), Vol. 75, No. 1, pp. 115-134, October, 2007. [pdf] [webpage]
	M. F. Tappen, C. Liu, E. H. Adelson and W. T. Freeman. Learning Gaussian conditional random fields for low-level vision. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-8, 2007. [pdf]
	C. Liu, W. T. Freeman and E. H. Adelson. Analysis of Contour Motions. Advances in Neural Information Processing Systems (NIPS), 2006. Oral presentation. Outstanding Student Paper Award. [pdf] [ppt] [webpage]
	C. Liu, W. T. Freeman, R. Szeliski and S. B. Kang. Noise estimation from a single image. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 901-908, 2006. Oral presentation. [pdf] [ppt] [webpage]
	C. Liu, A. Torralba, W.T . Freeman, F. Durand and E. H. Adelson. Motion magnification. ACM SIGGRAPH 2005, pp. 519-526, 2005. [pdf] [ppt] [webpage]
	L. Yuan, F. Wen, C. Liu and H. Y. Shum. Synthesizing dynamic texture with closed-loop linear dynamic system. European Conference on Computer Vision (ECCV), 2004. Oral presentation. [pdf]
	C. Y. Wu, C. Liu, H. Y. Shum, Y. Q. Xu and Z. Y. Zhang. Automatic eyeglasses removal from face images. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 26, No. 3, pp. 322-336, March 2004. [pdf]
	C. Liu and H. Y. Shum. Kullback-Leibler boosting. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 587-594, 2003. [pdf] [ppt]
	S. C. Yan, C. Liu, S. Z. Li, H.J. Zhang, H. Shum, Q. S. Cheng. Face alignment using texture constrained active shape models. Image and Vision Computing, Vol. 21, Issue 1, Pages 69-75, January, 2003. [pdf]
	Z. Q. Liu, C. Liu, H.Y . Shum and Y. Z. Yu. Pattern-based texture metamorphosis. Pacific Conference on Computer Graphics and Applications, pp. 184-193, 2002. [pdf] [ppt] [webpage]
	C. Liu, H. Y. Shum and S.C. Zhang. Hierarchical shape model for automatic face localization. European Conference on Computer Vision (ECCV), pp. 687-703, 2002. [pdf]
	C. Y. Wu, C. Liu, H. Y. Shum, Y. Q. Xu and Z. Y. Zhang. Automatic eyeglasses removal from face images. Asian Conference on Computer Vision (ACCV), pp. 193-198, 2002. [pdf]
	C. Liu, H. Y. Shum and C. S. Zhang. Two-step approach to hallucinating faces: global parametric model and local nonparametric model. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Vol. 1, pp. 192-198, 2001. Oral presentation. [pdf] [ppt] [webpage]
	L. Liang, C. Liu, Y. Q. Xu, B. N. Guo and H. Y. Shum. Real-time texture synthesis by patch-based sampling. ACM Transactions on Graphics (TOG), Vol. 20, No. 3, pp. 127-150, July 2001. [pdf] [webpage]
	C. Liu, S.C. Zhu and H. Y. Shum. Learning inhomogeneous Gibbs model of faces by minimax entropy. IEEE International Conference on Computer Vision (ICCV), pp. 281-287, 2001. [pdf] [webpage]

Code and Data

	Deep Convolutional Neural Network for Image Deconvolution
	Deformable spatial pyramid matching (DSPM) code
	Objective discovery and co-segmentation (database & evaulation code)
	Depth transfer data and Matlab/C++ code
	Label transfer data and Matlab/C++ code
	Optical flow Matlab/C++ code (updated!)
	SIFT flow Matlab/C++ code
	Image super resolution Matlab code
	Human-assisted motion annotation: database & C++ code