Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units
Depth range cameras are a promising solution for the 3DTV production chain. The generation of color images with their accompanying depth value simplifies the transmission bandwidth problem in 3DTV and yields a direct input for autostereoscopic displays. Recent developments in plenoptic video-cameras...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2010-01-01
|
Series: | International Journal of Digital Multimedia Broadcasting |
Online Access: | http://dx.doi.org/10.1155/2010/942037 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832549921987756032 |
---|---|
author | J. P. Lüke F. Pérez Nava J. G. Marichal-Hernández J. M. Rodríguez-Ramos F. Rosa |
author_facet | J. P. Lüke F. Pérez Nava J. G. Marichal-Hernández J. M. Rodríguez-Ramos F. Rosa |
author_sort | J. P. Lüke |
collection | DOAJ |
description | Depth range cameras are a promising solution for the 3DTV production chain. The generation of color images with their accompanying depth value simplifies the transmission bandwidth problem in 3DTV and yields a direct input for autostereoscopic displays. Recent developments in plenoptic video-cameras make it possible to introduce 3D cameras that operate similarly to traditional cameras. The use of plenoptic cameras for 3DTV has some benefits with respect to 3D capture systems based on dual stereo cameras since there is no need for geometric and color calibration or frame synchronization. This paper presents a method for simultaneously recovering depth and all-in-focus images from a plenoptic camera in near real time using graphics processing units (GPUs). Previous methods for 3D reconstruction using plenoptic images suffered from the drawback of low spatial resolution. A method that overcomes this deficiency is developed on parallel hardware to obtain near real-time 3D reconstruction with a final spatial resolution of 800×600 pixels. This resolution is suitable as an input to some autostereoscopic displays currently on the market and shows that real-time 3DTV based on plenoptic video-cameras is technologically feasible. |
format | Article |
id | doaj-art-316bf04c95734965a63f5b7d2db7a1b0 |
institution | Kabale University |
issn | 1687-7578 1687-7586 |
language | English |
publishDate | 2010-01-01 |
publisher | Wiley |
record_format | Article |
series | International Journal of Digital Multimedia Broadcasting |
spelling | doaj-art-316bf04c95734965a63f5b7d2db7a1b02025-02-03T06:08:17ZengWileyInternational Journal of Digital Multimedia Broadcasting1687-75781687-75862010-01-01201010.1155/2010/942037942037Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing UnitsJ. P. Lüke0F. Pérez Nava1J. G. Marichal-Hernández2J. M. Rodríguez-Ramos3F. Rosa4Departamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Estadística, Investigación Operativa y Computación, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepartamento de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna, 38203 Canary Islands, SpainDepth range cameras are a promising solution for the 3DTV production chain. The generation of color images with their accompanying depth value simplifies the transmission bandwidth problem in 3DTV and yields a direct input for autostereoscopic displays. Recent developments in plenoptic video-cameras make it possible to introduce 3D cameras that operate similarly to traditional cameras. The use of plenoptic cameras for 3DTV has some benefits with respect to 3D capture systems based on dual stereo cameras since there is no need for geometric and color calibration or frame synchronization. This paper presents a method for simultaneously recovering depth and all-in-focus images from a plenoptic camera in near real time using graphics processing units (GPUs). Previous methods for 3D reconstruction using plenoptic images suffered from the drawback of low spatial resolution. A method that overcomes this deficiency is developed on parallel hardware to obtain near real-time 3D reconstruction with a final spatial resolution of 800×600 pixels. This resolution is suitable as an input to some autostereoscopic displays currently on the market and shows that real-time 3DTV based on plenoptic video-cameras is technologically feasible.http://dx.doi.org/10.1155/2010/942037 |
spellingShingle | J. P. Lüke F. Pérez Nava J. G. Marichal-Hernández J. M. Rodríguez-Ramos F. Rosa Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units International Journal of Digital Multimedia Broadcasting |
title | Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units |
title_full | Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units |
title_fullStr | Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units |
title_full_unstemmed | Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units |
title_short | Near Real-Time Estimation of Super-Resolved Depth and All-In-Focus Images from a Plenoptic Camera Using Graphics Processing Units |
title_sort | near real time estimation of super resolved depth and all in focus images from a plenoptic camera using graphics processing units |
url | http://dx.doi.org/10.1155/2010/942037 |
work_keys_str_mv | AT jpluke nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits AT fpereznava nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits AT jgmarichalhernandez nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits AT jmrodriguezramos nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits AT frosa nearrealtimeestimationofsuperresolveddepthandallinfocusimagesfromaplenopticcamerausinggraphicsprocessingunits |