I am a Postdoctoral Associate in Bill Freeman's group in the Computer Science and Artificial Intelligence Laboratory (CSAIL) at MIT. I am interested in computational photography and computer vision. I did my Ph. D with Bill Freeman and worked on ways to visualize tiny changes in images and videos by amplifying them.
I obtained my Bachelor's in Mathematics from Harvard University in June of 2009. I have done internships at Mitsubishi Electric Research Laboratory (MERL) and at Google Research.
|January 2016||I graduated and submitted my Ph. D dissertation: Revealing and Analyzing Imperceptible Deviations in Images and Videos.|
|December 2015||I gave an invited talk at the Computer Vision for Affordable and Accessible Healthcare Workshop at the 2015 International Conference in Computer Vision (ICCV).|
|October 2015||I have a new paper at SIGGRAPH Asia titled Deviation Magnification: Revealing Departures from Ideal Geometries.|
|May 2015||I gave an invited talk at the National Board for Medical Examiners in Philadelphia, Pennsylvania.|
|June 2014||Awarded Best Demo at CVPR 2014 for Real-time Video Magnification.|
SoftwarePhase Based Video Motion Processing code Matlab code for implementing the new and improved phase-based motion magnification pipeline.
Deviation Magnification: Revealing Departures from Ideal Geometries
Neal Wadhwa, Tali Dekel, Donglai Wei, Frédo Durand, William T. FreemanACM Transactions on Graphics, Volume 34, Number 6 (Proc. SIGGRAPH Asia), 2015.
A method to reveal subtle deviations of objects from ideal geometries, like lines or cirlces, in a single image by magnifying them.
Refraction Wiggles for Measuring Fluid Depth and Velocity from Video
Tianfan Xue, Michael Rubinstein, Neal Wadhwa, Anat Levin, Frédo Durand, William T. FreemanProc. of European Conference on Computer Vision (ECCV), 2014.
A method to recover the velocity and depth of hot air from video.
The Visual Microphone: Passive Recovery of Sound from Video
Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham Mysore, Frédo Durand, William T. FreemanACM Transactions on Graphics, Volume 33, Number 4 (Proc. SIGGRAPH), 2014.
A technique to recover sound from videos of objects subtly vibrating in response to sound.
Structural Modal Identification through High Speed Camera Video: Motion Magnification
Justin G. Chen, Neal Wadhwa, Young-Jin Cha, Frédo Durand, William T. Freeman, Oral BuyukozturkProceedings of the 32nd International Modal Analysis Conference (2014)
A validation that the motion magnified motions are indeed real and a way to compute the mode shapes of a cantilevered beam from video.
Riesz Pyramids for Fast Phase-Based Video Magnification
Neal Wadhwa, Michael Rubinstein, Frédo Durand, William T. FreemanComputational Photography (ICCP), 2014 IEEE International Conference on
[Paper] [Webpage] [Pseudocode]
Provides the quality of the previous phase-based technique with the real-time speed of the original linear technique.
Phase-based Video Motion Processing
Neal Wadhwa, Michael Rubinstein, Frédo Durand, William T. FreemanACM Transactions on Graphics, Volume 32, Number 4 (Proc. SIGGRAPH), 2013.
[Paper] [Webpage] [BibTeX]
A new technique to amplify small motions that solves the noise amplification and intensity clipping artifacts of the previous linear method by manipulating the phase in sub-bands of videos.
Revealing Invisible Changes In The World
Michael Rubinstein, Neal Wadhwa, Frédo Durand, William T. FreemanScience Vol. 339 No. 6119, Feb 1 2013
[Article in Science] [Video] [NSF SciVis 2012] [BibTeX]
An expository video showcasing our results and explaining our technique.