Samuel W. Hasinoff, Sing Bing Kang, and Richard Szeliski, Boundary Matting for View Synthesis. Computer Vision and Image Understanding, 103(1), pp. 22-32, 2006. [pdf]
Samuel W. Hasinoff, Sing Bing Kang, and Richard Szeliski, Boundary Matting for View Synthesis, Second IEEE Workshop on Image and Video Registration (with CVPR 2004), 8 pp. (DVD proceedings). [pdf]
To produce seamless view interpolation, we propose a method called boundary matting, which represents each occlusion boundary as a 3D curve. We show how this method exploits multiple views to perform fully automatic alpha matting and to simultaneously refine stereo depths at the boundaries. The key to our approach is the 3D representation of occlusion boundaries estimated to sub-pixel accuracy. Starting from an initial estimate derived from stereo, we optimize the curve parameters and the foreground colors near the boundaries. Our objective function maximizes consistency with the input images, favors boundaries aligned with strong edges, and damps large perturbations of the curves. Experimental results suggest that this method enables high-quality view synthesis with reduced matting artifacts.