Chuang Gan;

Chuang Gan

I am a principal research staff member at MIT-IBM Watson AI Lab. I am also a visiting research scientist at MIT, working closely with Prof. Antonio Torralba and Prof. Josh Tenenbaum. Before that, I completed my PhD with the highest honor at Tsinghua University, where I was supervised by Prof. Andrew Chi-Chih Yao. I primarily focus on video understanding, including representation learning, neural-symbolic visual reasoning, audio-visual scene analysis and skill learning. My research works have been recognized by Microsoft Fellowship, Baidu Fellowship, and media coverage from CNN, BBC, The New York Times, WIRED, Forbes, and MIT Tech Review.

During my PhD, I was fortunate enough to work with:


Google Scholar | Contact | News | Publications | Competitions | Data & Software | Talks | Honors


Email: ganchuang [at] csail (dot) mit (dot) edu


  • I am looking to hire research interns with strong background on RL, Embodied AI, Robotics, Visual Reasoning or Video Understanding.
  • Code, dataset and evaluation server of Video CLEVRER have been released.

    Publications(by date / by topic)


    • Rank 1st in ActivityNet AVA Challenge 2018

    • Rank 1st in ActivityNet Kinetics Challenge 2017

    • Rank 1st in NIST TRECVID MED and MER 2014

    • Rank 2nd in Moments in Time 2018

    • Rank 3rd in Youtube8M Challenge 2017

    • Rank 3rd in ActivityNet classification Challenge 2016

    Data & Software

    NS-VQA. Neural-Symbolic Visual Reasoning.

    WSDEC. Weakly-supervised Dense Event Captioning.

    The Sound of Pixels. Listen to the sound of pixels.

    Smart Contours. Edit images using contours.

    Attention Clusters. Multiple and diverse attention for video classification.

    SCN. Semantic composition network for image and video captioning.

    VQS. Visual question segmentation.

    TVNET. End to end video motion learning.

    Youtube8M. Temporal modeling for video classification.


    Video Understanding: From Tags to Language.

    Stanford University, MSR, AI2, NEC, NVDIA, Baidu, MERL, IBM, UCF (2017)


    • Outstanding Doctoral Thesis Award at Tsinghua University (2018)

    • Excellent Graduate Student at Tsinghua University (2018)

    • Top Talented Graduate Student at Tsinghua University (2017)

    • Academic Rising Star Finalist at Tsinghua University (2016, 2017)

    • Microsoft Fellowship (2016)

    • Baidu Fellowship (2016)

    • National Scholarship, by Ministry of Education of China (2015)