Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
Accurate localisation is key for the autonomy of mobile robots. Fiducial localisation utilises relative positions of markers physically deployed across an environment to determine a localisation estimate for a robot. Fiducial markers are strictly designed, with very limited flexibility in appearance...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2024-12-01
|
Series: | Machines |
Subjects: | |
Online Access: | https://www.mdpi.com/2075-1702/13/1/2 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832588089082511360 |
---|---|
author | James R. Heselden Dimitris Paparas Robert L. Stevenson Gautham P. Das |
author_facet | James R. Heselden Dimitris Paparas Robert L. Stevenson Gautham P. Das |
author_sort | James R. Heselden |
collection | DOAJ |
description | Accurate localisation is key for the autonomy of mobile robots. Fiducial localisation utilises relative positions of markers physically deployed across an environment to determine a localisation estimate for a robot. Fiducial markers are strictly designed, with very limited flexibility in appearance. This often results in a “trade-off” between visual customisation, library size, and occlusion resilience. Many fiducial localisation approaches vary in their position estimation over time, leading to instability. The Stable Fiducial Marker System (STag) was designed to address this limitation with the use of a two-stage homography detection. Through its combined square and circle detection phases, it can refine detection stability. In this work, we explore the utility of STag as a basis for a stable mobile robot localisation system. Key marker restrictions are addressed in this work through contributions of three new chromatic STag marker types. The hue/greyscale STag marker set addresses constraints in customisability, the high-capacity STag marker set addresses limitations in library size, and the high-occlusion STag marker set improves resilience to occlusions. These are designed with compatibility with the STag detection system, requiring only preprocessing steps for enhanced detection. They are assessed against the existing STag markers and each shows clear improvements. Further, we explore the viability of various materials for marker fabrication, for use in outdoor and low-light conditions. This includes the exploration of “active” materials which induce effects such as retro-reflectance and photo-luminescence. Detection rates are experimentally assessed across lighting conditions, with “active” markers assessed on the practicality of their effects. To encapsulate this work, we have developed a full end-to-end deployment for fiducial localisation under the STag system. It is shown to function for both on-board and off-board localisation, with deployment in practical robot trials. As a part of this contribution, the associated software for marker set generation/detection, physical marker fabrication, and end-to-end localisation has been released as an open source distribution. |
format | Article |
id | doaj-art-c65c62eb48414ed4af784ef2e794b648 |
institution | Kabale University |
issn | 2075-1702 |
language | English |
publishDate | 2024-12-01 |
publisher | MDPI AG |
record_format | Article |
series | Machines |
spelling | doaj-art-c65c62eb48414ed4af784ef2e794b6482025-01-24T13:39:05ZengMDPI AGMachines2075-17022024-12-01131210.3390/machines13010002Enhanced STag Marker System: Materials and Methods for Flexible Robot LocalisationJames R. Heselden0Dimitris Paparas1Robert L. Stevenson2Gautham P. Das3Lincoln Institute for Agri-Food Technology (LIAT), University of Lincoln, Riseholme Campus, Lincoln LN2 2LG, UKDepartment of Engineering, University of Cambridge, Cambridge CB2 1TN, UKLincoln Centre for Autonomous Systems (L-CAS), University of Lincoln, Brayford Pool Campus, Lincoln LN6 7TS, UKLincoln Institute for Agri-Food Technology (LIAT), University of Lincoln, Riseholme Campus, Lincoln LN2 2LG, UKAccurate localisation is key for the autonomy of mobile robots. Fiducial localisation utilises relative positions of markers physically deployed across an environment to determine a localisation estimate for a robot. Fiducial markers are strictly designed, with very limited flexibility in appearance. This often results in a “trade-off” between visual customisation, library size, and occlusion resilience. Many fiducial localisation approaches vary in their position estimation over time, leading to instability. The Stable Fiducial Marker System (STag) was designed to address this limitation with the use of a two-stage homography detection. Through its combined square and circle detection phases, it can refine detection stability. In this work, we explore the utility of STag as a basis for a stable mobile robot localisation system. Key marker restrictions are addressed in this work through contributions of three new chromatic STag marker types. The hue/greyscale STag marker set addresses constraints in customisability, the high-capacity STag marker set addresses limitations in library size, and the high-occlusion STag marker set improves resilience to occlusions. These are designed with compatibility with the STag detection system, requiring only preprocessing steps for enhanced detection. They are assessed against the existing STag markers and each shows clear improvements. Further, we explore the viability of various materials for marker fabrication, for use in outdoor and low-light conditions. This includes the exploration of “active” materials which induce effects such as retro-reflectance and photo-luminescence. Detection rates are experimentally assessed across lighting conditions, with “active” markers assessed on the practicality of their effects. To encapsulate this work, we have developed a full end-to-end deployment for fiducial localisation under the STag system. It is shown to function for both on-board and off-board localisation, with deployment in practical robot trials. As a part of this contribution, the associated software for marker set generation/detection, physical marker fabrication, and end-to-end localisation has been released as an open source distribution.https://www.mdpi.com/2075-1702/13/1/2fiducial markersrobot localisationSTag markersocclusion resistance |
spellingShingle | James R. Heselden Dimitris Paparas Robert L. Stevenson Gautham P. Das Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation Machines fiducial markers robot localisation STag markers occlusion resistance |
title | Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation |
title_full | Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation |
title_fullStr | Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation |
title_full_unstemmed | Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation |
title_short | Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation |
title_sort | enhanced stag marker system materials and methods for flexible robot localisation |
topic | fiducial markers robot localisation STag markers occlusion resistance |
url | https://www.mdpi.com/2075-1702/13/1/2 |
work_keys_str_mv | AT jamesrheselden enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation AT dimitrispaparas enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation AT robertlstevenson enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation AT gauthampdas enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation |