Real-time Triangulation Matting using Passive Polarization


Morgan McGuire Wojciech Matusik
Brown University MERL
Technical Sketch
Siggraph 2006





Blue screen matting separates foreground and background elements of video for special effects shots. It balances the benefit of realtime performance against the drawbacks of blue light spill throughout the scene. In this sketch we replace the traditional blue screen with a gray, polarized one, and film the scene with a single camera containing two differently-polarized sensors. For each frame, this camera simultaneously captures an image of the actor against an apparently black background and an apparently gray background. From these two images we can triangulate the foreground color and matte; this is an extension of a mathematically similar idea by Smith and Blinn that was previously applicable only to static scenes. Our new method operates in real-time on video. It has comparable controls and setup to blue-screen matting, which is the de facto standard for practicality. Unlike blue-screen matting, our gray screen does not impact the illumination color of the scene.



Morgan McGuire, Wojciech Matusik. Real-time Triangulation Matting using Passive Polarization. Technical Sketch, Siggraph 2006.