Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

We present a multicamera real-time 3D modeling system that aims at enabling new immersive and interactive environments. This system, called Grimage, allows to retrieve in real-time a 3D mesh of the observed scene as well as the associated textures. This information enables a strong visual presence o...

Full description

Saved in:
Bibliographic Details
Main Authors: Benjamin Petit, Jean-Denis Lesage, Clément Menier, Jérémie Allard, Jean-Sébastien Franco, Bruno Raffin, Edmond Boyer, François Faure
Format: Article
Language:English
Published: Wiley 2010-01-01
Series:International Journal of Digital Multimedia Broadcasting
Online Access:http://dx.doi.org/10.1155/2010/247108
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832564041787113472
author Benjamin Petit
Jean-Denis Lesage
Clément Menier
Jérémie Allard
Jean-Sébastien Franco
Bruno Raffin
Edmond Boyer
François Faure
author_facet Benjamin Petit
Jean-Denis Lesage
Clément Menier
Jérémie Allard
Jean-Sébastien Franco
Bruno Raffin
Edmond Boyer
François Faure
author_sort Benjamin Petit
collection DOAJ
description We present a multicamera real-time 3D modeling system that aims at enabling new immersive and interactive environments. This system, called Grimage, allows to retrieve in real-time a 3D mesh of the observed scene as well as the associated textures. This information enables a strong visual presence of the user into virtual worlds. The 3D shape information is also used to compute collisions and reaction forces with virtual objects, enforcing the mechanical presence of the user in the virtual world. The innovation is a fully integrated system with both immersive and interactive capabilities. It embeds a parallel version of the EPVH modeling algorithm inside a distributed vision pipeline. It also adopts the hierarchical component approach of the FlowVR middleware to enforce software modularity and enable distributed executions. Results show high refresh rates and low latencies obtained by taking advantage of the I/O and computing resources of PC clusters. The applications we have developed demonstrate the quality of the visual and mechanical presence with a single platform and with a dual platform that allows telecollaboration.
format Article
id doaj-art-13abbccf20694796a1c806f3370ac2a9
institution Kabale University
issn 1687-7578
1687-7586
language English
publishDate 2010-01-01
publisher Wiley
record_format Article
series International Journal of Digital Multimedia Broadcasting
spelling doaj-art-13abbccf20694796a1c806f3370ac2a92025-02-03T01:11:54ZengWileyInternational Journal of Digital Multimedia Broadcasting1687-75781687-75862010-01-01201010.1155/2010/247108247108Multicamera Real-Time 3D Modeling for Telepresence and Remote CollaborationBenjamin Petit0Jean-Denis Lesage1Clément Menier2Jérémie Allard3Jean-Sébastien Franco4Bruno Raffin5Edmond Boyer6François Faure7INRIA Grenoble, 655 avenue de l'Europe, 38330 Montbonnot Saint Martin, FranceUniversité de Grenoble , LIG, 51 avenue Jean Kuntzmann, 38330 Montbonnot Saint Martin, France4D View Solutions, 655 avenue de l'Europe, 38330 Montbonnot Saint Martin, FranceINRIA Lille-Nord Europe, LIFL, Parc Scientifique de la Haute Borne, 59650 Villeneuve d'Ascq, FranceUniversité Bordeaux, LaBRI, INRIA Sud-Ouest, 351 cours de la Libération, 33405 Talence, FranceINRIA Grenoble, LIG, 51 avenue Jean Kuntzmann, 38330 Montbonnot Saint Martin, FranceUniversité de Grenoble, LJK, INRIA Grenoble, 655 avenue de l'Europe, 38330 Montbonnot Saint Martin, FranceUniversité de Grenoble, LJK, INRIA Grenoble, 655 avenue de l'Europe, 38330 Montbonnot Saint Martin, FranceWe present a multicamera real-time 3D modeling system that aims at enabling new immersive and interactive environments. This system, called Grimage, allows to retrieve in real-time a 3D mesh of the observed scene as well as the associated textures. This information enables a strong visual presence of the user into virtual worlds. The 3D shape information is also used to compute collisions and reaction forces with virtual objects, enforcing the mechanical presence of the user in the virtual world. The innovation is a fully integrated system with both immersive and interactive capabilities. It embeds a parallel version of the EPVH modeling algorithm inside a distributed vision pipeline. It also adopts the hierarchical component approach of the FlowVR middleware to enforce software modularity and enable distributed executions. Results show high refresh rates and low latencies obtained by taking advantage of the I/O and computing resources of PC clusters. The applications we have developed demonstrate the quality of the visual and mechanical presence with a single platform and with a dual platform that allows telecollaboration.http://dx.doi.org/10.1155/2010/247108
spellingShingle Benjamin Petit
Jean-Denis Lesage
Clément Menier
Jérémie Allard
Jean-Sébastien Franco
Bruno Raffin
Edmond Boyer
François Faure
Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration
International Journal of Digital Multimedia Broadcasting
title Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration
title_full Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration
title_fullStr Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration
title_full_unstemmed Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration
title_short Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration
title_sort multicamera real time 3d modeling for telepresence and remote collaboration
url http://dx.doi.org/10.1155/2010/247108
work_keys_str_mv AT benjaminpetit multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT jeandenislesage multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT clementmenier multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT jeremieallard multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT jeansebastienfranco multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT brunoraffin multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT edmondboyer multicamerarealtime3dmodelingfortelepresenceandremotecollaboration
AT francoisfaure multicamerarealtime3dmodelingfortelepresenceandremotecollaboration