Chuang Gan;

Chuang Gan

I am a principal research staff member at MIT-IBM Watson AI Lab. I am also a visiting research scientist at MIT, working closely with Prof. Antonio Torralba and Prof. Josh Tenenbaum. Before that, I completed my PhD with the highest honor at Tsinghua University, where I was supervised by Prof. Andrew Chi-Chih Yao. I primarily focus on video understanding, including representation learning, neural-symbolic visual reasoning, audio-visual scene analysis and skill learning. My research works have been recognized by Microsoft Fellowship, Baidu Fellowship, and media coverage from CNN, BBC, The New York Times, WIRED, Forbes, and MIT Tech Review.


During my PhD, I was fortunate enough to work with:

 

Google Scholar | Contact | News | Publications | Competitions | Data & Software | Talks | Honors

 


Email: ganchuang [at] csail (dot) mit (dot) edu


News

  • Code, dataset and evaluation server of Video CLEVRER have been released.
  • Poject page of Foly Music is online.

  • I will co-organize the Neuro-Symbolic Visual Reasoning and Program Synthesis tutorial at CVPR 2020.

  • Poject page of Music Gesture is online.

  • Poject page of Audio-Visual Navigation is online.

  • Auditory Vehicle Tracking dataset has been released.


    Publications(by date / by topic)


    Competitions

    • Rank 1st in ActivityNet AVA Challenge 2018

    • Rank 1st in ActivityNet Kinetics Challenge 2017

    • Rank 1st in NIST TRECVID MED and MER 2014

    • Rank 2nd in Moments in Time 2018

    • Rank 3rd in Youtube8M Challenge 2017

    • Rank 3rd in ActivityNet classification Challenge 2016


    Data & Software

    • NS-VQA. Neural-Symbolic Visual Reasoning.

    • WSDEC. Weakly-supervised Dense Event Captioning.

    • The Sound of Pixels. Listen to the sound of pixels.

    • Smart Contours. Edit images using contours.

    • Attention Clusters. Multiple and diverse attention for video classification.

    • SCN. Semantic composition network for image and video captioning.

    • VQS. Visual question segmentation.

    • TVNET. End to end video motion learning.

    • Youtube8M. Temporal modeling for video classification.


    Talks

    Video Understanding: From Tags to Language.

    Stanford University, MSR, AI2, NEC, NVDIA, Baidu, MERL, IBM, UCF (2017)


    Honors

    • Outstanding Doctoral Thesis Award at Tsinghua University (2018)

    • Excellent Graduate Student at Tsinghua University (2018)

    • Top Talented Graduate Student at Tsinghua University (2017)

    • Academic Rising Star Finalist at Tsinghua University (2016, 2017)

    • Microsoft Fellowship (2016)

    • Baidu Fellowship (2016)

    • National Scholarship, by Ministry of Education of China (2015)


    conter12