Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets
Image and video completion are essential tasks in the field of image and video processing, often used for restoring damaged regions in images and video frames. The primary challenge in these tasks is to complete them in such a way that they do not introduce noticeable artifacts or inconsistencies to...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
REA Press
2025-03-01
|
| Series: | Big Data and Computing Visions |
| Subjects: | |
| Online Access: | https://www.bidacv.com/article_204770_6ce2318ccc66896395ada9544a1888e0.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832579304426307584 |
|---|---|
| author | Amanna Ghanbari Talouki Abbas Koochari Seyyed Ahmad Edalatpanah |
| author_facet | Amanna Ghanbari Talouki Abbas Koochari Seyyed Ahmad Edalatpanah |
| author_sort | Amanna Ghanbari Talouki |
| collection | DOAJ |
| description | Image and video completion are essential tasks in the field of image and video processing, often used for restoring damaged regions in images and video frames. The primary challenge in these tasks is to complete them in such a way that they do not introduce noticeable artifacts or inconsistencies to the viewer. While image completion focuses on filling in missing parts in a static context, video completion requires additional considerations due to the temporal dimension. The motion of objects and the preservation of temporal consistency are critical factors in video completion. This research proposes a novel method for image and video completion based on Neutrosophic theory, which handles uncertainty in both spatial and intensity domains. Neutrosophy is utilized to interpret the indeterminacy present in images, allowing for more accurate segmentation and better handling of incomplete data. The proposed method first segments the image using Neutrosophic-based segmentation and then uses the segmented information to guide the completion of missing regions. For video completion, a two-step approach is introduced that separates static backgrounds from moving objects. The background is reconstructed using image completion based on Neutrosophic-based segmentation, and the foreground is completed by identifying appropriate data that best match the missing parts; this data is chosen using a contour-based method, which this method applies neutrosophic sets to get to the most suitable data. The novelty of the approach lies in several key contributions: 1) the use of Neutrosophic theory to handle spatial and intensity uncertainties, 2) a Neutrosophic-based similarity measure for image segmentation, 3) a new metric for finding the most suitable patch for hole filling, and 4) a novel method for preserving boundaries and uniformity in video completion, particularly in the presence of moving objects. Experimental results demonstrate the effectiveness of the proposed methods, with improved visual quality and reduced inconsistencies compared to previous state-of-the-art methods. However, challenges remain in applying the method to highly detailed images with many classes and handling dynamic backgrounds. |
| format | Article |
| id | doaj-art-bbbdde80d44e460993e212c697e74c56 |
| institution | Kabale University |
| issn | 2783-4956 2821-014X |
| language | English |
| publishDate | 2025-03-01 |
| publisher | REA Press |
| record_format | Article |
| series | Big Data and Computing Visions |
| spelling | doaj-art-bbbdde80d44e460993e212c697e74c562025-01-30T12:23:51ZengREA PressBig Data and Computing Visions2783-49562821-014X2025-03-015111010.22105/bdcv.2024.477690.1188204770Video completion in the presence of moving subjects based on segmentation using Neutrosophic setsAmanna Ghanbari Talouki0Abbas Koochari1Seyyed Ahmad Edalatpanah2Department of Technical and Engineering, Ayandegan Institute of Higher Education, Tonekabon, Mazandaran, Iran.Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran.Department of Applied Mathematics, Ayandegan Institute of Higher Education, Tonekabon, Mazandaran, Iran.Image and video completion are essential tasks in the field of image and video processing, often used for restoring damaged regions in images and video frames. The primary challenge in these tasks is to complete them in such a way that they do not introduce noticeable artifacts or inconsistencies to the viewer. While image completion focuses on filling in missing parts in a static context, video completion requires additional considerations due to the temporal dimension. The motion of objects and the preservation of temporal consistency are critical factors in video completion. This research proposes a novel method for image and video completion based on Neutrosophic theory, which handles uncertainty in both spatial and intensity domains. Neutrosophy is utilized to interpret the indeterminacy present in images, allowing for more accurate segmentation and better handling of incomplete data. The proposed method first segments the image using Neutrosophic-based segmentation and then uses the segmented information to guide the completion of missing regions. For video completion, a two-step approach is introduced that separates static backgrounds from moving objects. The background is reconstructed using image completion based on Neutrosophic-based segmentation, and the foreground is completed by identifying appropriate data that best match the missing parts; this data is chosen using a contour-based method, which this method applies neutrosophic sets to get to the most suitable data. The novelty of the approach lies in several key contributions: 1) the use of Neutrosophic theory to handle spatial and intensity uncertainties, 2) a Neutrosophic-based similarity measure for image segmentation, 3) a new metric for finding the most suitable patch for hole filling, and 4) a novel method for preserving boundaries and uniformity in video completion, particularly in the presence of moving objects. Experimental results demonstrate the effectiveness of the proposed methods, with improved visual quality and reduced inconsistencies compared to previous state-of-the-art methods. However, challenges remain in applying the method to highly detailed images with many classes and handling dynamic backgrounds.https://www.bidacv.com/article_204770_6ce2318ccc66896395ada9544a1888e0.pdfvideo completionvideo inpaintingsegmentation hole fillingneutrosophic sets |
| spellingShingle | Amanna Ghanbari Talouki Abbas Koochari Seyyed Ahmad Edalatpanah Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets Big Data and Computing Visions video completion video inpainting segmentation hole filling neutrosophic sets |
| title | Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets |
| title_full | Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets |
| title_fullStr | Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets |
| title_full_unstemmed | Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets |
| title_short | Video completion in the presence of moving subjects based on segmentation using Neutrosophic sets |
| title_sort | video completion in the presence of moving subjects based on segmentation using neutrosophic sets |
| topic | video completion video inpainting segmentation hole filling neutrosophic sets |
| url | https://www.bidacv.com/article_204770_6ce2318ccc66896395ada9544a1888e0.pdf |
| work_keys_str_mv | AT amannaghanbaritalouki videocompletioninthepresenceofmovingsubjectsbasedonsegmentationusingneutrosophicsets AT abbaskoochari videocompletioninthepresenceofmovingsubjectsbasedonsegmentationusingneutrosophicsets AT seyyedahmadedalatpanah videocompletioninthepresenceofmovingsubjectsbasedonsegmentationusingneutrosophicsets |