Vision-based manipulation of transparent plastic bags in industrial setups
IntroductionThis paper addresses the challenges of vision-based manipulation for autonomous cutting and unpacking of transparent plastic bags in industrial setups, contributing to the Industry 4.0 paradigm. Industry 4.0, emphasizing data-driven processes, connectivity, and robotics, enhances accessi...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-01-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2025.1506290/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832585042782584832 |
|---|---|
| author | F. Adetunji F. Adetunji A. Karukayil A. Karukayil P. Samant P. Samant S. Shabana S. Shabana F. Varghese F. Varghese U. Upadhyay U. Upadhyay R. A. Yadav R. A. Yadav A. Partridge E. Pendleton R. Plant Y. R. Petillot Y. R. Petillot M. Koskinopoulou M. Koskinopoulou |
| author_facet | F. Adetunji F. Adetunji A. Karukayil A. Karukayil P. Samant P. Samant S. Shabana S. Shabana F. Varghese F. Varghese U. Upadhyay U. Upadhyay R. A. Yadav R. A. Yadav A. Partridge E. Pendleton R. Plant Y. R. Petillot Y. R. Petillot M. Koskinopoulou M. Koskinopoulou |
| author_sort | F. Adetunji |
| collection | DOAJ |
| description | IntroductionThis paper addresses the challenges of vision-based manipulation for autonomous cutting and unpacking of transparent plastic bags in industrial setups, contributing to the Industry 4.0 paradigm. Industry 4.0, emphasizing data-driven processes, connectivity, and robotics, enhances accessibility and sustainability across the value chain. Integrating autonomous systems, including collaborative robots (cobots), into industrial workflows is crucial for improving efficiency and safety.MethodsThe proposed system employs advanced Machine Learning algorithms, particularly Convolutional Neural Networks (CNNs), for identifying transparent plastic bags under diverse lighting and background conditions. Tracking algorithms and depth-sensing technologies are integrated to enable 3D spatial awareness during pick-and-place operations. The system incorporates vacuum gripping technology with compliance control for optimal grasping and manipulation points, using a Franka Emika robot arm.ResultsThe system successfully demonstrates its capability to automate the unpacking and cutting of transparent plastic bags for an 8-stack bulk-loader. Rigorous lab testing showed high accuracy in bag detection and manipulation under varying environmental conditions, as well as reliable performance in handling and processing tasks. The approach effectively addressed challenges related to transparency, plastic bag manipulation and industrial automation.DiscussionThe results indicate that the proposed solution is highly effective for industrial applications requiring precision and adaptability, aligning with the principles of Industry 4.0. By combining advanced vision algorithms, depth sensing, and compliance control, the system offers a robust method for automating challenging tasks. The integration of cobots into such workflows demonstrates significant potential for enhancing efficiency, safety, and sustainability in industrial settings. |
| format | Article |
| id | doaj-art-0491d8077b8b4c7b842bad0124ae0089 |
| institution | Kabale University |
| issn | 2296-9144 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-0491d8077b8b4c7b842bad0124ae00892025-01-27T05:14:35ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442025-01-011210.3389/frobt.2025.15062901506290Vision-based manipulation of transparent plastic bags in industrial setupsF. Adetunji0F. Adetunji1A. Karukayil2A. Karukayil3P. Samant4P. Samant5S. Shabana6S. Shabana7F. Varghese8F. Varghese9U. Upadhyay10U. Upadhyay11R. A. Yadav12R. A. Yadav13A. Partridge14E. Pendleton15R. Plant16Y. R. Petillot17Y. R. Petillot18M. Koskinopoulou19M. Koskinopoulou20The School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomThe School of Physical and Engineering Sciences, Heriot-Watt University, Edinburgh, United KingdomThe National Robotarium, Edinburgh, United KingdomIntroductionThis paper addresses the challenges of vision-based manipulation for autonomous cutting and unpacking of transparent plastic bags in industrial setups, contributing to the Industry 4.0 paradigm. Industry 4.0, emphasizing data-driven processes, connectivity, and robotics, enhances accessibility and sustainability across the value chain. Integrating autonomous systems, including collaborative robots (cobots), into industrial workflows is crucial for improving efficiency and safety.MethodsThe proposed system employs advanced Machine Learning algorithms, particularly Convolutional Neural Networks (CNNs), for identifying transparent plastic bags under diverse lighting and background conditions. Tracking algorithms and depth-sensing technologies are integrated to enable 3D spatial awareness during pick-and-place operations. The system incorporates vacuum gripping technology with compliance control for optimal grasping and manipulation points, using a Franka Emika robot arm.ResultsThe system successfully demonstrates its capability to automate the unpacking and cutting of transparent plastic bags for an 8-stack bulk-loader. Rigorous lab testing showed high accuracy in bag detection and manipulation under varying environmental conditions, as well as reliable performance in handling and processing tasks. The approach effectively addressed challenges related to transparency, plastic bag manipulation and industrial automation.DiscussionThe results indicate that the proposed solution is highly effective for industrial applications requiring precision and adaptability, aligning with the principles of Industry 4.0. By combining advanced vision algorithms, depth sensing, and compliance control, the system offers a robust method for automating challenging tasks. The integration of cobots into such workflows demonstrates significant potential for enhancing efficiency, safety, and sustainability in industrial settings.https://www.frontiersin.org/articles/10.3389/frobt.2025.1506290/fullautonomous systemsindustrial applicationsvision-guided manipulationtransparent bag detectionrobotic solutions |
| spellingShingle | F. Adetunji F. Adetunji A. Karukayil A. Karukayil P. Samant P. Samant S. Shabana S. Shabana F. Varghese F. Varghese U. Upadhyay U. Upadhyay R. A. Yadav R. A. Yadav A. Partridge E. Pendleton R. Plant Y. R. Petillot Y. R. Petillot M. Koskinopoulou M. Koskinopoulou Vision-based manipulation of transparent plastic bags in industrial setups Frontiers in Robotics and AI autonomous systems industrial applications vision-guided manipulation transparent bag detection robotic solutions |
| title | Vision-based manipulation of transparent plastic bags in industrial setups |
| title_full | Vision-based manipulation of transparent plastic bags in industrial setups |
| title_fullStr | Vision-based manipulation of transparent plastic bags in industrial setups |
| title_full_unstemmed | Vision-based manipulation of transparent plastic bags in industrial setups |
| title_short | Vision-based manipulation of transparent plastic bags in industrial setups |
| title_sort | vision based manipulation of transparent plastic bags in industrial setups |
| topic | autonomous systems industrial applications vision-guided manipulation transparent bag detection robotic solutions |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2025.1506290/full |
| work_keys_str_mv | AT fadetunji visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT fadetunji visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT akarukayil visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT akarukayil visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT psamant visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT psamant visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT sshabana visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT sshabana visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT fvarghese visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT fvarghese visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT uupadhyay visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT uupadhyay visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT rayadav visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT rayadav visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT apartridge visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT ependleton visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT rplant visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT yrpetillot visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT yrpetillot visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT mkoskinopoulou visionbasedmanipulationoftransparentplasticbagsinindustrialsetups AT mkoskinopoulou visionbasedmanipulationoftransparentplasticbagsinindustrialsetups |