Adversarial imitation learning with deep attention network for swarm systems

Abstract Swarm systems consist of a large number of interacting individuals, which exhibit complex behavior despite having simple interaction rules. However, crafting individual motion policies that can manifest desired collective behaviors poses a significant challenge due to the intricate relation...

Full description

Saved in:
Bibliographic Details
Main Authors: Yapei Wu, Tao Wang, Tong Liu, Zhicheng Zheng, Demin Xu, Xingguang Peng
Format: Article
Language:English
Published: Springer 2024-11-01
Series:Complex & Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1007/s40747-024-01662-2
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832571185839210496
author Yapei Wu
Tao Wang
Tong Liu
Zhicheng Zheng
Demin Xu
Xingguang Peng
author_facet Yapei Wu
Tao Wang
Tong Liu
Zhicheng Zheng
Demin Xu
Xingguang Peng
author_sort Yapei Wu
collection DOAJ
description Abstract Swarm systems consist of a large number of interacting individuals, which exhibit complex behavior despite having simple interaction rules. However, crafting individual motion policies that can manifest desired collective behaviors poses a significant challenge due to the intricate relationship between individual policies and swarm dynamics. This paper addresses this issue by proposing an imitation learning method, which derives individual policies from collective behavior data. The approach leverages an adversarial imitation learning framework, with a deep attention network serving as the individual policy network. Our method successfully imitates three distinct collective behaviors. Utilizing the ease of analysis provided by the deep attention network, we have verified that the individual policies underlying a certain collective behavior are not unique. Additionally, we have analyzed the different individual policies discovered. Lastly, we validate the applicability of the proposed method in designing policies for swarm robots through practical implementation on swarm robots.
format Article
id doaj-art-9bd03965936248abbc96acf7467bbaf6
institution Kabale University
issn 2199-4536
2198-6053
language English
publishDate 2024-11-01
publisher Springer
record_format Article
series Complex & Intelligent Systems
spelling doaj-art-9bd03965936248abbc96acf7467bbaf62025-02-02T12:48:41ZengSpringerComplex & Intelligent Systems2199-45362198-60532024-11-0111111810.1007/s40747-024-01662-2Adversarial imitation learning with deep attention network for swarm systemsYapei Wu0Tao Wang1Tong Liu2Zhicheng Zheng3Demin Xu4Xingguang Peng5School of Marine Science and Technology, Northwestern Polytechnical UniversitySchool of Marine Science and Technology, Northwestern Polytechnical UniversitySchool of Marine Science and Technology, Northwestern Polytechnical UniversitySchool of Marine Science and Technology, Northwestern Polytechnical UniversitySchool of Marine Science and Technology, Northwestern Polytechnical UniversitySchool of Marine Science and Technology, Northwestern Polytechnical UniversityAbstract Swarm systems consist of a large number of interacting individuals, which exhibit complex behavior despite having simple interaction rules. However, crafting individual motion policies that can manifest desired collective behaviors poses a significant challenge due to the intricate relationship between individual policies and swarm dynamics. This paper addresses this issue by proposing an imitation learning method, which derives individual policies from collective behavior data. The approach leverages an adversarial imitation learning framework, with a deep attention network serving as the individual policy network. Our method successfully imitates three distinct collective behaviors. Utilizing the ease of analysis provided by the deep attention network, we have verified that the individual policies underlying a certain collective behavior are not unique. Additionally, we have analyzed the different individual policies discovered. Lastly, we validate the applicability of the proposed method in designing policies for swarm robots through practical implementation on swarm robots.https://doi.org/10.1007/s40747-024-01662-2Swarm systemAdversarial imitation learningDeep attention networkSwarm robots
spellingShingle Yapei Wu
Tao Wang
Tong Liu
Zhicheng Zheng
Demin Xu
Xingguang Peng
Adversarial imitation learning with deep attention network for swarm systems
Complex & Intelligent Systems
Swarm system
Adversarial imitation learning
Deep attention network
Swarm robots
title Adversarial imitation learning with deep attention network for swarm systems
title_full Adversarial imitation learning with deep attention network for swarm systems
title_fullStr Adversarial imitation learning with deep attention network for swarm systems
title_full_unstemmed Adversarial imitation learning with deep attention network for swarm systems
title_short Adversarial imitation learning with deep attention network for swarm systems
title_sort adversarial imitation learning with deep attention network for swarm systems
topic Swarm system
Adversarial imitation learning
Deep attention network
Swarm robots
url https://doi.org/10.1007/s40747-024-01662-2
work_keys_str_mv AT yapeiwu adversarialimitationlearningwithdeepattentionnetworkforswarmsystems
AT taowang adversarialimitationlearningwithdeepattentionnetworkforswarmsystems
AT tongliu adversarialimitationlearningwithdeepattentionnetworkforswarmsystems
AT zhichengzheng adversarialimitationlearningwithdeepattentionnetworkforswarmsystems
AT deminxu adversarialimitationlearningwithdeepattentionnetworkforswarmsystems
AT xingguangpeng adversarialimitationlearningwithdeepattentionnetworkforswarmsystems