Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units

Depth range cameras are a promising solution for the 3DTV production chain. The generation of color images with their accompanying depth value simplifies the transmission bandwidth problem in 3DTV and yields a direct input for autostereoscopic displays. Recent developments in plenoptic video-cameras...

Full description

Saved in:
Bibliographic Details
Main Authors: J. P. Lüke, F. Pérez Nava, J. G. Marichal-Hernández, J. M. Rodríguez-Ramos, F. Rosa
Format: Article
Language:English
Published: Wiley 2010-01-01
Series:International Journal of Digital Multimedia Broadcasting
Online Access:http://dx.doi.org/10.1155/2010/942037
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832549921987756032
author J. P. Lüke
F. Pérez Nava
J. G. Marichal-Hernández
J. M. Rodríguez-Ramos
F. Rosa
author_facet J. P. Lüke
F. Pérez Nava
J. G. Marichal-Hernández
J. M. Rodríguez-Ramos
F. Rosa
author_sort J. P. Lüke
collection DOAJ
description Depth range cameras are a promising solution for the 3DTV production chain. The generation of color images with their accompanying depth value simplifies the transmission bandwidth problem in 3DTV and yields a direct input for autostereoscopic displays. Recent developments in plenoptic video-cameras make it possible to introduce 3D cameras that operate similarly to traditional cameras. The use of plenoptic cameras for 3DTV has some benefits with respect to 3D capture systems based on dual stereo cameras since there is no need for geometric and color calibration or frame synchronization. This paper presents a method for simultaneously recovering depth and all-in-focus images from a plenoptic camera in near real time using graphics processing units (GPUs). Previous methods for 3D reconstruction using plenoptic images suffered from the drawback of low spatial resolution. A method that overcomes this deficiency is developed on parallel hardware to obtain near real-time 3D reconstruction with a final spatial resolution of 800×600 pixels. This resolution is suitable as an input to some autostereoscopic displays currently on the market and shows that real-time 3DTV based on plenoptic video-cameras is technologically feasible.
format Article
id doaj-art-316bf04c95734965a63f5b7d2db7a1b0
institution Kabale University
issn 1687-7578
1687-7586
language English
publishDate 2010-01-01
publisher Wiley
record_format Article
series International Journal of Digital Multimedia Broadcasting
spelling doaj-art-316bf04c95734965a63f5b7d2db7a1b02025-02-03T06:08:17ZengWileyInternational Journal of Digital Multimedia Broadcasting1687-75781687-75862010-01-01201010.1155/2010/942037942037Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing UnitsJ. P. Lüke0F. Pérez Nava1J. G. Marichal-Hernández2J. M. Rodríguez-Ramos3F. Rosa4Departamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Estadística, Investigación Operativa y Computación, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepth range cameras are a promising solution for the 3DTV production chain. The generation of color images with their accompanying depth value simplifies the transmission bandwidth problem in 3DTV and yields a direct input for autostereoscopic displays. Recent developments in plenoptic video-cameras make it possible to introduce 3D cameras that operate similarly to traditional cameras. The use of plenoptic cameras for 3DTV has some benefits with respect to 3D capture systems based on dual stereo cameras since there is no need for geometric and color calibration or frame synchronization. This paper presents a method for simultaneously recovering depth and all-in-focus images from a plenoptic camera in near real time using graphics processing units (GPUs). Previous methods for 3D reconstruction using plenoptic images suffered from the drawback of low spatial resolution. A method that overcomes this deficiency is developed on parallel hardware to obtain near real-time 3D reconstruction with a final spatial resolution of 800×600 pixels. This resolution is suitable as an input to some autostereoscopic displays currently on the market and shows that real-time 3DTV based on plenoptic video-cameras is technologically feasible.http://dx.doi.org/10.1155/2010/942037
spellingShingle J. P. Lüke
F. Pérez Nava
J. G. Marichal-Hernández
J. M. Rodríguez-Ramos
F. Rosa
Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
International Journal of Digital Multimedia Broadcasting
title Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
title_full Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
title_fullStr Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
title_full_unstemmed Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
title_short Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
title_sort near real time estimation of super resolved depth and all in focus images from a plenoptic camera using graphics processing units
url http://dx.doi.org/10.1155/2010/942037
work_keys_str_mv AT jpluke nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits
AT fpereznava nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits
AT jgmarichalhernandez nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits
AT jmrodriguezramos nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits
AT frosa nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits