About me

I am a postdoctoral associate at the Massachusetts Institute of Technology. I work at CSAIL with the Computer Vision group and am advised by Professor William Freeman.

Previously, I completed my PhD at the Massachusetts Institute of Technology under the guidance of Professor Antonio Torralba. I received my bachelor degree at University of California - Berkeley, where I worked in the Computer Vision lab under the guidance of Professor Jitendra Malik. I also have spent time at Microsoft Research, Adobe Creative Technologies Lab, Google, and UC Berkeley.



Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning

Jiajun Wu*, Ilker Yildirim*, Joseph J. Lim, William T. Freeman, Joshua B. Tenenbaum. (* - indicates equal contribution)

NIPS 2015, Montreal, Canada. [PDF]

Discovering States and Transformations in Image Collections

Phillip Isola*, Joseph J. Lim*, Edward H. Adelson. (* - indicates equal contribution)

CVPR 2015, Boston, Massachusetts. [PDF]

FPM: Fine pose Parts-based Model with 3D CAD models

Joseph J. Lim, Aditya Khosla, Antonio Torralba.

ECCV 2014, Zurich, Switzerland. [PDF]

Looking Beyond the Visible Scene

Aditya Khosla*, Byoungkwon An*, Joseph J. Lim*, Antonio Torralba. (* - indicates equal contribution)

CVPR 2014, Columbus, Ohio. [PDF] [Project Page]

Parsing IKEA Objects: Fine Pose Estimation

Joseph J. Lim, Hamed Pirsiavash, Antonio Torralba.

ICCV 2013, Sydney, Australia. [PDF] [Project Page]

Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection

Joseph J. Lim, C. Lawrence Zitnick, and Piotr Dollar.

CVPR 2013, Portland, Oregon. [PDF] [Code github, zip]

Transfer Learning by Borrowing Examples for Multiclass Object Detection

Joseph J. Lim, Ruslan Salakhutdinov, and Antonio Torralba.

NIPS 2011, Granada, Spain. [PDF] [Project Page]

Experimental Evaluation of Support Vector Machine-based and Correlation-based Approaches to Automatic Particle Selection

Pablo Arbelaez, Bong-Gyoon Han, Dieter Typke, Joseph J. Lim, Robert M. Glaeser, Jitendra Malik.

Journal of Structural Biology 2011. doi:10.1016/j.jsb.2011.05.017. [PDF] [Project Page] [Code]

Exploiting Hierarchical Context on a Large Database of Object Categories

Myung Jin Choi, Joseph J. Lim, Antonio Torralba, and Alan S. Willsky.

CVPR 2010, San Francisco, California. [PDF] [Project Page]

Context by Region Ancestry

Joseph J. Lim, Pablo Arbelaez, Chunhui Gu, Jitendra Malik.

ICCV 2009, Kyoto, Japan. [PDF]

Recognition using Regions

Chunhui Gu, Joseph J. Lim, Pablo Arbelaez, Jitendra Malik.

CVPR 2009, Miami, Florida. [PDF]

A Distributed Message Passing Algorithm for Sensor Localization

Max Welling and Joseph J. Lim.

ICANN 2007, Porto, Portugal. [PDF] June '08, mistake corrected in Alg. Box 3I.


  • Course Instructor (Winter 2014). 6.S093 Visual Recognition through Machine Learning Competition
  • Teaching Assistant (Spring 2010). 6.869: Advances in Computer Vision
  • NSF Graduate Research Fellowship (2009-2014)
  • Organization: Workshop on Object Understanding for Interaction (ICCV 2015), CMT Assistant (CVPR 2015)
  • Reviewer: ICCV (2011-2015), ECCV (2012-2014), CVPR (2011-2015), ACCV (2012,2014), IJCV, TPAMI
  • Program Committee: SUN workshop - CVPR (2013), Story Telling workshop - ECCV (2014), 3D from a single image workshop - CVPR (2015)


  • MIT's Computer Vision Link
  • UC Berkeley's Computer Vision Link
  • Yongwhan Lim (my brother)'s website Link