Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor
3D reconstruction based on structured light or laser scan has been widely used in industrial measurement, robot navigation, and virtual reality. However, most modern range sensors fail to scan transparent objects and some other special materials, of which the surface cannot reflect back the accurate...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2017-01-01
|
| Series: | International Journal of Optics |
| Online Access: | http://dx.doi.org/10.1155/2017/9796127 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832554725923356672 |
|---|---|
| author | Yijun Ji Qing Xia Zhijiang Zhang |
| author_facet | Yijun Ji Qing Xia Zhijiang Zhang |
| author_sort | Yijun Ji |
| collection | DOAJ |
| description | 3D reconstruction based on structured light or laser scan has been widely used in industrial measurement, robot navigation, and virtual reality. However, most modern range sensors fail to scan transparent objects and some other special materials, of which the surface cannot reflect back the accurate depth because of the absorption and refraction of light. In this paper, we fuse the depth and silhouette information from an RGB-D sensor (Kinect v1) to recover the lost surface of transparent objects. Our system is divided into two parts. First, we utilize the zero and wrong depth led by transparent materials from multiple views to search for the 3D region which contains the transparent object. Then, based on shape from silhouette technology, we recover the 3D model by visual hull within these noisy regions. Joint Grabcut segmentation is operated on multiple color images to extract the silhouette. The initial constraint for Grabcut is automatically determined. Experiments validate that our approach can improve the 3D model of transparent object in real-world scene. Our system is time-saving, robust, and without any interactive operation throughout the process. |
| format | Article |
| id | doaj-art-a81e98572d57483588090b5af22fdcfe |
| institution | Kabale University |
| issn | 1687-9384 1687-9392 |
| language | English |
| publishDate | 2017-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Journal of Optics |
| spelling | doaj-art-a81e98572d57483588090b5af22fdcfe2025-02-03T05:50:46ZengWileyInternational Journal of Optics1687-93841687-93922017-01-01201710.1155/2017/97961279796127Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D SensorYijun Ji0Qing Xia1Zhijiang Zhang2Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Shanghai University, Shanghai, ChinaKey Laboratory of Specialty Fiber Optics and Optical Access Networks, Shanghai University, Shanghai, ChinaKey Laboratory of Specialty Fiber Optics and Optical Access Networks, Shanghai University, Shanghai, China3D reconstruction based on structured light or laser scan has been widely used in industrial measurement, robot navigation, and virtual reality. However, most modern range sensors fail to scan transparent objects and some other special materials, of which the surface cannot reflect back the accurate depth because of the absorption and refraction of light. In this paper, we fuse the depth and silhouette information from an RGB-D sensor (Kinect v1) to recover the lost surface of transparent objects. Our system is divided into two parts. First, we utilize the zero and wrong depth led by transparent materials from multiple views to search for the 3D region which contains the transparent object. Then, based on shape from silhouette technology, we recover the 3D model by visual hull within these noisy regions. Joint Grabcut segmentation is operated on multiple color images to extract the silhouette. The initial constraint for Grabcut is automatically determined. Experiments validate that our approach can improve the 3D model of transparent object in real-world scene. Our system is time-saving, robust, and without any interactive operation throughout the process.http://dx.doi.org/10.1155/2017/9796127 |
| spellingShingle | Yijun Ji Qing Xia Zhijiang Zhang Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor International Journal of Optics |
| title | Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor |
| title_full | Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor |
| title_fullStr | Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor |
| title_full_unstemmed | Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor |
| title_short | Fusing Depth and Silhouette for Scanning Transparent Object with RGB-D Sensor |
| title_sort | fusing depth and silhouette for scanning transparent object with rgb d sensor |
| url | http://dx.doi.org/10.1155/2017/9796127 |
| work_keys_str_mv | AT yijunji fusingdepthandsilhouetteforscanningtransparentobjectwithrgbdsensor AT qingxia fusingdepthandsilhouetteforscanningtransparentobjectwithrgbdsensor AT zhijiangzhang fusingdepthandsilhouetteforscanningtransparentobjectwithrgbdsensor |