Factored Time-Lapse Video

 

Kalyan Sunkavalli Wojciech Matusik Hanspeter Pfister Szymon Rusinkiewicz
MERL MERL MERL Princeton University

 
SIGGRAPH 2007

 

We decompose a time-lapse sequence of photographs (a) into sun, sky, shadow, and reflectance components. The representation permits re-rendering without shadows (b) and without skylight (c), or modifying the reflectance of surfaces in the scene (d).

 

Abstract

 

We describe a method for converting time-lapse photography captured with outdoor cameras into Factored Time-Lapse Video (FTLV): a video in which time appears to move faster (i.e., lapsing) and where data at each pixel has been factored into shadow, illumination, and reflectance components. The factorization allows a user to easily relight the scene, recover a portion of the scene geometry (normals), and to perform advanced image editing operations. Our method is easy to implement, robust, and provides a compact representation with good reconstruction characteristics. We show results using several publicly available time-lapse sequences.

 

Citation

Kalyan Sunkavalli, Wojciech Matusik, Hanspeter Pfister, and Szymon Rusinkiewicz. Factored Time-Lapse Video. ACM Transactions on Graphics. 26(3) August 2007.

Paper

PDF (28 MB)

Video

Quicktime (13 MB)

Presentation

PPT (not available yet)