Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation

Accurate localisation is key for the autonomy of mobile robots. Fiducial localisation utilises relative positions of markers physically deployed across an environment to determine a localisation estimate for a robot. Fiducial markers are strictly designed, with very limited flexibility in appearance...

Full description

Saved in:
Bibliographic Details
Main Authors: James R. Heselden, Dimitris Paparas, Robert L. Stevenson, Gautham P. Das
Format: Article
Language:English
Published: MDPI AG 2024-12-01
Series:Machines
Subjects:
Online Access:https://www.mdpi.com/2075-1702/13/1/2
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588089082511360
author James R. Heselden
Dimitris Paparas
Robert L. Stevenson
Gautham P. Das
author_facet James R. Heselden
Dimitris Paparas
Robert L. Stevenson
Gautham P. Das
author_sort James R. Heselden
collection DOAJ
description Accurate localisation is key for the autonomy of mobile robots. Fiducial localisation utilises relative positions of markers physically deployed across an environment to determine a localisation estimate for a robot. Fiducial markers are strictly designed, with very limited flexibility in appearance. This often results in a “trade-off” between visual customisation, library size, and occlusion resilience. Many fiducial localisation approaches vary in their position estimation over time, leading to instability. The Stable Fiducial Marker System (STag) was designed to address this limitation with the use of a two-stage homography detection. Through its combined square and circle detection phases, it can refine detection stability. In this work, we explore the utility of STag as a basis for a stable mobile robot localisation system. Key marker restrictions are addressed in this work through contributions of three new chromatic STag marker types. The hue/greyscale STag marker set addresses constraints in customisability, the high-capacity STag marker set addresses limitations in library size, and the high-occlusion STag marker set improves resilience to occlusions. These are designed with compatibility with the STag detection system, requiring only preprocessing steps for enhanced detection. They are assessed against the existing STag markers and each shows clear improvements. Further, we explore the viability of various materials for marker fabrication, for use in outdoor and low-light conditions. This includes the exploration of “active” materials which induce effects such as retro-reflectance and photo-luminescence. Detection rates are experimentally assessed across lighting conditions, with “active” markers assessed on the practicality of their effects. To encapsulate this work, we have developed a full end-to-end deployment for fiducial localisation under the STag system. It is shown to function for both on-board and off-board localisation, with deployment in practical robot trials. As a part of this contribution, the associated software for marker set generation/detection, physical marker fabrication, and end-to-end localisation has been released as an open source distribution.
format Article
id doaj-art-c65c62eb48414ed4af784ef2e794b648
institution Kabale University
issn 2075-1702
language English
publishDate 2024-12-01
publisher MDPI AG
record_format Article
series Machines
spelling doaj-art-c65c62eb48414ed4af784ef2e794b6482025-01-24T13:39:05ZengMDPI AGMachines2075-17022024-12-01131210.3390/machines13010002Enhanced STag Marker System: Materials and Methods for Flexible Robot LocalisationJames R. Heselden0Dimitris Paparas1Robert L. Stevenson2Gautham P. Das3Lincoln Institute for Agri-Food Technology (LIAT), University of Lincoln, Riseholme Campus, Lincoln LN2 2LG, UKDepartment of Engineering, University of Cambridge, Cambridge CB2 1TN, UKLincoln Centre for Autonomous Systems (L-CAS), University of Lincoln, Brayford Pool Campus, Lincoln LN6 7TS, UKLincoln Institute for Agri-Food Technology (LIAT), University of Lincoln, Riseholme Campus, Lincoln LN2 2LG, UKAccurate localisation is key for the autonomy of mobile robots. Fiducial localisation utilises relative positions of markers physically deployed across an environment to determine a localisation estimate for a robot. Fiducial markers are strictly designed, with very limited flexibility in appearance. This often results in a “trade-off” between visual customisation, library size, and occlusion resilience. Many fiducial localisation approaches vary in their position estimation over time, leading to instability. The Stable Fiducial Marker System (STag) was designed to address this limitation with the use of a two-stage homography detection. Through its combined square and circle detection phases, it can refine detection stability. In this work, we explore the utility of STag as a basis for a stable mobile robot localisation system. Key marker restrictions are addressed in this work through contributions of three new chromatic STag marker types. The hue/greyscale STag marker set addresses constraints in customisability, the high-capacity STag marker set addresses limitations in library size, and the high-occlusion STag marker set improves resilience to occlusions. These are designed with compatibility with the STag detection system, requiring only preprocessing steps for enhanced detection. They are assessed against the existing STag markers and each shows clear improvements. Further, we explore the viability of various materials for marker fabrication, for use in outdoor and low-light conditions. This includes the exploration of “active” materials which induce effects such as retro-reflectance and photo-luminescence. Detection rates are experimentally assessed across lighting conditions, with “active” markers assessed on the practicality of their effects. To encapsulate this work, we have developed a full end-to-end deployment for fiducial localisation under the STag system. It is shown to function for both on-board and off-board localisation, with deployment in practical robot trials. As a part of this contribution, the associated software for marker set generation/detection, physical marker fabrication, and end-to-end localisation has been released as an open source distribution.https://www.mdpi.com/2075-1702/13/1/2fiducial markersrobot localisationSTag markersocclusion resistance
spellingShingle James R. Heselden
Dimitris Paparas
Robert L. Stevenson
Gautham P. Das
Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
Machines
fiducial markers
robot localisation
STag markers
occlusion resistance
title Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
title_full Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
title_fullStr Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
title_full_unstemmed Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
title_short Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation
title_sort enhanced stag marker system materials and methods for flexible robot localisation
topic fiducial markers
robot localisation
STag markers
occlusion resistance
url https://www.mdpi.com/2075-1702/13/1/2
work_keys_str_mv AT jamesrheselden enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation
AT dimitrispaparas enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation
AT robertlstevenson enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation
AT gauthampdas enhancedstagmarkersystemmaterialsandmethodsforflexiblerobotlocalisation