Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game
Decreasing the position error and control torque is important for the coordinate control of a modular unmanned system with less communication burden between the sensor and the actuator. Therefore, this paper proposes event-trigger reinforcement learning (ETRL)-based coordinate control of a modular u...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/25/2/314 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832587589438144512 |
|---|---|
| author | Yebao Liu Tianjiao An Jianguo Chen Luyang Zhong Yuhan Qian |
| author_facet | Yebao Liu Tianjiao An Jianguo Chen Luyang Zhong Yuhan Qian |
| author_sort | Yebao Liu |
| collection | DOAJ |
| description | Decreasing the position error and control torque is important for the coordinate control of a modular unmanned system with less communication burden between the sensor and the actuator. Therefore, this paper proposes event-trigger reinforcement learning (ETRL)-based coordinate control of a modular unmanned system (MUS) via the nonzero-sum game (NZSG) strategy. The dynamic model of the MUS is established via joint torque feedback (JTF) technology. Based on the NZSG strategy, the existing coordinate control problem is transformed into an RL issue. With the help of the ET mechanism, the periodic communication mechanism of the system is avoided. The ET-critic neural network (NN) is used to approximate the performance index function, thus obtaining the ETRL coordinate control policy. The stability of the closed-loop system is verified via Lyapunov’s theorem. Experiment results demonstrate the validity of the proposed method. The experimental results show that the proposed method reduces the position error by 30% and control torque by 10% compared with the existing control methods. |
| format | Article |
| id | doaj-art-a99a721a11804b0aac018e9d80025f53 |
| institution | Kabale University |
| issn | 1424-8220 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-a99a721a11804b0aac018e9d80025f532025-01-24T13:48:28ZengMDPI AGSensors1424-82202025-01-0125231410.3390/s25020314Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum GameYebao Liu0Tianjiao An1Jianguo Chen2Luyang Zhong3Yuhan Qian4Aerospace Times Feihong Technology Company Limited, Beijing 130012, ChinaDepartment of Control Science and Engineering, Changchun University of Technology, Changchun 130012, ChinaAerospace Times Feihong Technology Company Limited, Beijing 130012, ChinaAerospace Times Feihong Technology Company Limited, Beijing 130012, ChinaAerospace Times Feihong Technology Company Limited, Beijing 130012, ChinaDecreasing the position error and control torque is important for the coordinate control of a modular unmanned system with less communication burden between the sensor and the actuator. Therefore, this paper proposes event-trigger reinforcement learning (ETRL)-based coordinate control of a modular unmanned system (MUS) via the nonzero-sum game (NZSG) strategy. The dynamic model of the MUS is established via joint torque feedback (JTF) technology. Based on the NZSG strategy, the existing coordinate control problem is transformed into an RL issue. With the help of the ET mechanism, the periodic communication mechanism of the system is avoided. The ET-critic neural network (NN) is used to approximate the performance index function, thus obtaining the ETRL coordinate control policy. The stability of the closed-loop system is verified via Lyapunov’s theorem. Experiment results demonstrate the validity of the proposed method. The experimental results show that the proposed method reduces the position error by 30% and control torque by 10% compared with the existing control methods.https://www.mdpi.com/1424-8220/25/2/314reinforcement learningnonzero-sum gameoptimal controlevent-trigger |
| spellingShingle | Yebao Liu Tianjiao An Jianguo Chen Luyang Zhong Yuhan Qian Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game Sensors reinforcement learning nonzero-sum game optimal control event-trigger |
| title | Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game |
| title_full | Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game |
| title_fullStr | Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game |
| title_full_unstemmed | Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game |
| title_short | Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game |
| title_sort | event trigger reinforcement learning based coordinate control of modular unmanned system via nonzero sum game |
| topic | reinforcement learning nonzero-sum game optimal control event-trigger |
| url | https://www.mdpi.com/1424-8220/25/2/314 |
| work_keys_str_mv | AT yebaoliu eventtriggerreinforcementlearningbasedcoordinatecontrolofmodularunmannedsystemvianonzerosumgame AT tianjiaoan eventtriggerreinforcementlearningbasedcoordinatecontrolofmodularunmannedsystemvianonzerosumgame AT jianguochen eventtriggerreinforcementlearningbasedcoordinatecontrolofmodularunmannedsystemvianonzerosumgame AT luyangzhong eventtriggerreinforcementlearningbasedcoordinatecontrolofmodularunmannedsystemvianonzerosumgame AT yuhanqian eventtriggerreinforcementlearningbasedcoordinatecontrolofmodularunmannedsystemvianonzerosumgame |