Virtual view specification and synthesis in free viewpoint television application

Wenfeng Li, Jin Zhou, Baoxin Li, M. Ibrahim Sezan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

In conventional TV, users can get only a single view of a real 3D world. The view is determined not by a user but by the camera position during acquisition. Free viewpoint television (FTV) is a new concept which aims at giving viewers the flexibility to select a novel viewpoint by employing multiple video streams as the input. Current proposed solutions for FTV include those based on ray-space sampling and interpolation. Most existing work makes the assumption that the cameras are calibrated. Moreover, virtual view specification is done in ways that would not be practical for actual use (e.g., some methods specify the virtual view by a rotation matrix and a translation vector). This paper proposes a framework for FTV based on image-based rendering, complete with key algorithms for color-based segmentation and correspondence, and multiple-image-based virtual view synthesis from uncalibrated cameras. Moreover, we propose an intuitive approach to specifying the virtual viewpoint, based on any two views chosen by the user. This makes the specification of the virtual view very intuitive and thus practical for the FTV application. Experiments with real video streams were performed to validate the proposed approaches.

Original languageEnglish (US)
Title of host publicationProceedings - 3rd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006
PublisherIEEE Computer Society
Pages464-471
Number of pages8
ISBN (Print)0769528252, 9780769528250
DOIs
StatePublished - Jan 1 2006
Event3rd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006 - Chapel Hill, NC, United States
Duration: Jun 14 2006Jun 16 2006

Publication series

NameProceedings - Third International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006

Other

Other3rd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006
CountryUnited States
CityChapel Hill, NC
Period6/14/066/16/06

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Virtual view specification and synthesis in free viewpoint television application'. Together they form a unique fingerprint.

Cite this