A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems

This paper proposes an adaptive formation tracking control algorithm optimized by Q-learning scheme for multiple mobile robots. In order to handle the model uncertainties and external disturbances, a desired linear extended state observer is designed to develop an adaptive formation tracking control...

Full description

Saved in:
Bibliographic Details
Main Authors: Chen Zhang, Wen Qin, Ming-Can Fan, Ting Wang, Mou-Quan Shen
Format: Article
Language:English
Published: Wiley 2022-01-01
Series:Complexity
Online Access:http://dx.doi.org/10.1155/2022/5093277
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832559161805635584
author Chen Zhang
Wen Qin
Ming-Can Fan
Ting Wang
Mou-Quan Shen
author_facet Chen Zhang
Wen Qin
Ming-Can Fan
Ting Wang
Mou-Quan Shen
author_sort Chen Zhang
collection DOAJ
description This paper proposes an adaptive formation tracking control algorithm optimized by Q-learning scheme for multiple mobile robots. In order to handle the model uncertainties and external disturbances, a desired linear extended state observer is designed to develop an adaptive formation tracking control strategy. Then an adaptive method of sliding mode control parameters optimized by Q-learning scheme is employed, which can avoid the complex parameter tuning process. Furthermore, the stability of the closed-loop control system is rigorously proved by means of matrix properties of graph theory and Lyapunov theory, and the formation tracking errors can be guaranteed to be uniformly ultimately bounded. Finally, simulations are presented to show the proposed algorithm has the advantages of faster convergence rate, higher tracking accuracy, and better steady-state performance.
format Article
id doaj-art-a509fa2992a44c1ea38026764195d5b9
institution Kabale University
issn 1099-0526
language English
publishDate 2022-01-01
publisher Wiley
record_format Article
series Complexity
spelling doaj-art-a509fa2992a44c1ea38026764195d5b92025-02-03T01:30:39ZengWileyComplexity1099-05262022-01-01202210.1155/2022/5093277A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot SystemsChen Zhang0Wen Qin1Ming-Can Fan2Ting Wang3Mou-Quan Shen4College of Electrical Engineering and Control ScienceCollege of Electrical Engineering and Control ScienceSchool of Mathematics and StatisticsCollege of Electrical Engineering and Control ScienceCollege of Electrical Engineering and Control ScienceThis paper proposes an adaptive formation tracking control algorithm optimized by Q-learning scheme for multiple mobile robots. In order to handle the model uncertainties and external disturbances, a desired linear extended state observer is designed to develop an adaptive formation tracking control strategy. Then an adaptive method of sliding mode control parameters optimized by Q-learning scheme is employed, which can avoid the complex parameter tuning process. Furthermore, the stability of the closed-loop control system is rigorously proved by means of matrix properties of graph theory and Lyapunov theory, and the formation tracking errors can be guaranteed to be uniformly ultimately bounded. Finally, simulations are presented to show the proposed algorithm has the advantages of faster convergence rate, higher tracking accuracy, and better steady-state performance.http://dx.doi.org/10.1155/2022/5093277
spellingShingle Chen Zhang
Wen Qin
Ming-Can Fan
Ting Wang
Mou-Quan Shen
A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems
Complexity
title A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems
title_full A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems
title_fullStr A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems
title_full_unstemmed A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems
title_short A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems
title_sort q learning based parameters adaptive algorithm for formation tracking control of multi mobile robot systems
url http://dx.doi.org/10.1155/2022/5093277
work_keys_str_mv AT chenzhang aqlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT wenqin aqlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT mingcanfan aqlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT tingwang aqlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT mouquanshen aqlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT chenzhang qlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT wenqin qlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT mingcanfan qlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT tingwang qlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems
AT mouquanshen qlearningbasedparametersadaptivealgorithmforformationtrackingcontrolofmultimobilerobotsystems