Abstract:

Multi-view autostereoscopic displays provide an immersive, glasses-free 3D viewing experience, but they require correctly filtered content from multiple viewpoints. This, however, cannot be easily obtained with current stereoscopic production pipelines. We provide a practical solution that takes a stereoscopic video as an input and converts it to multi-view and filtered video streams that can be used to drive multi-view autostereoscopic displays. The method combines a phase-based video magnification and an interperspective antialiasing into a single filtering process. The whole algorithm is simple and can be efficiently implemented on current GPUs to yield a near real-time performance. Furthermore, the ability to retarget disparity is naturally supported. Our method is robust and works well for challenging video scenes with defocus blur, motion blur, transparent materials, and specularities. We show that our results are superior when compared to the state-of-the-art depth-based rendering methods. Finally, we showcase the method in the context of a real-time 3D videoconferencing system that requires only two cameras.

Materials for download:

Related publications:

	Luminance-Contrast-Aware Disparity Model and Applications Piotr Didyk, Tobias Ritschel, Elmar Eisemann, Karol Myszkowski, Hans-Peter Seidel, Wojciech Matusik Proceedings of ACM Transactions on Graphics 31(6) (Proceedings SIGGRAPH Asia 2012, Singapore), 2012 Paper Video BibTeX Project Page
	Adaptive Image-space Stereo View Synthesis Piotr Didyk, Tobias Ritschel, Elmar Eisemann, Karol Myszkowski, Hans-Peter Seidel Proceedings of Vision, Modeling and Visualization Workshop, 15-17 November 2010, Siegen, Germany. Paper Video BibTeX Project Page

Citation:

Piotr Didyk, Pitchaya Sitthi-Amorn, William T. Freeman, Frédo Durand, Wojciech Matusik
Joint View Expansion and Filtering for Automultiscopic 3D Displays
ACM Transactions on Graphics 32(6) (Proceedings SIGGRAPH Asia 2013, Hong Kong), 2013

  @article{DidykSFDM2013,
    author = { Piotr Didyk and
	       Pitchaya Sitthi-Amorn and
	       William T. Freeman and
	       Fr{\'e}do Durand and
	       Wojciech Matusik
	     },
    title     = {Joint View Expansion and Filtering for Automultiscopic 3D Displays},
    journal   = {ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2013, Hong Kong)},
    year      = {2013},
    volume    = {32},
    number    = {6}
  }