A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision
Autonomous maneuvering decision-making in unmanned serial vehicles (UAVs) is crucial for executing complex missions involving both individual and swarm UAV operations. Leveraging the successful deployment of recommendation systems in commerce and online applications, this paper pioneers a framework...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-12-01
|
| Series: | Drones |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2504-446X/9/1/25 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832588656008757248 |
|---|---|
| author | Qinzhi Hao Tengyu Jing Yao Sun Zhuolin Yang Jiali Zhang Jiapeng Wang Wei Wang |
| author_facet | Qinzhi Hao Tengyu Jing Yao Sun Zhuolin Yang Jiali Zhang Jiapeng Wang Wei Wang |
| author_sort | Qinzhi Hao |
| collection | DOAJ |
| description | Autonomous maneuvering decision-making in unmanned serial vehicles (UAVs) is crucial for executing complex missions involving both individual and swarm UAV operations. Leveraging the successful deployment of recommendation systems in commerce and online applications, this paper pioneers a framework tailored for UAV maneuvering decisions. This novel approach harnesses recommendation systems to enhance decision-making in UAV maneuvers. Our framework incorporates a comprehensive six-degree-of-freedom dynamics model that integrates gravitational effects and defines mission success criteria. We developed an integrated learning recommendation system capable of simulating varied mission scenarios, facilitating the acquisition of optimal strategies from a blend of expert human input and algorithmic outputs. The system supports extensive simulation capabilities, including various control modes (manual, autonomous, and hybrid) and both continuous and discrete maneuver actions. Through rigorous computer-based testing, we validated the effectiveness of established recommendation algorithms within our framework. Notably, the prioritized experience replay deep deterministic policy gradient (PER-DDPG) algorithm, employing dense rewards and continuous actions, demonstrated superior performance, achieving a 69% success rate in confrontational scenarios against a versatile expert algorithm after 1000 training iterations, marking an 80% reduction in training time compared to conventional reinforcement learning methods. This framework not only streamlines the comparison of different maneuvering algorithms but also promotes the integration of multi-source expert knowledge and sophisticated algorithms, paving the way for advanced UAV applications in complex operational environments. |
| format | Article |
| id | doaj-art-d53b6ad8e6cd4ed7b7671bffd003a556 |
| institution | Kabale University |
| issn | 2504-446X |
| language | English |
| publishDate | 2024-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Drones |
| spelling | doaj-art-d53b6ad8e6cd4ed7b7671bffd003a5562025-01-24T13:29:41ZengMDPI AGDrones2504-446X2024-12-01912510.3390/drones9010025A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver DecisionQinzhi Hao0Tengyu Jing1Yao Sun2Zhuolin Yang3Jiali Zhang4Jiapeng Wang5Wei Wang6Graduate School, Air Force Engineering University, Xi’an 710051, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaGraduate School, Air Force Engineering University, Xi’an 710051, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaAutonomous maneuvering decision-making in unmanned serial vehicles (UAVs) is crucial for executing complex missions involving both individual and swarm UAV operations. Leveraging the successful deployment of recommendation systems in commerce and online applications, this paper pioneers a framework tailored for UAV maneuvering decisions. This novel approach harnesses recommendation systems to enhance decision-making in UAV maneuvers. Our framework incorporates a comprehensive six-degree-of-freedom dynamics model that integrates gravitational effects and defines mission success criteria. We developed an integrated learning recommendation system capable of simulating varied mission scenarios, facilitating the acquisition of optimal strategies from a blend of expert human input and algorithmic outputs. The system supports extensive simulation capabilities, including various control modes (manual, autonomous, and hybrid) and both continuous and discrete maneuver actions. Through rigorous computer-based testing, we validated the effectiveness of established recommendation algorithms within our framework. Notably, the prioritized experience replay deep deterministic policy gradient (PER-DDPG) algorithm, employing dense rewards and continuous actions, demonstrated superior performance, achieving a 69% success rate in confrontational scenarios against a versatile expert algorithm after 1000 training iterations, marking an 80% reduction in training time compared to conventional reinforcement learning methods. This framework not only streamlines the comparison of different maneuvering algorithms but also promotes the integration of multi-source expert knowledge and sophisticated algorithms, paving the way for advanced UAV applications in complex operational environments.https://www.mdpi.com/2504-446X/9/1/25recommendation systemmaneuver decisioncollaborative filteringdeep reinforcement learningdense reward |
| spellingShingle | Qinzhi Hao Tengyu Jing Yao Sun Zhuolin Yang Jiali Zhang Jiapeng Wang Wei Wang A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision Drones recommendation system maneuver decision collaborative filtering deep reinforcement learning dense reward |
| title | A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision |
| title_full | A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision |
| title_fullStr | A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision |
| title_full_unstemmed | A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision |
| title_short | A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision |
| title_sort | framework of recommendation system for unmanned aerial vehicle autonomous maneuver decision |
| topic | recommendation system maneuver decision collaborative filtering deep reinforcement learning dense reward |
| url | https://www.mdpi.com/2504-446X/9/1/25 |
| work_keys_str_mv | AT qinzhihao aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT tengyujing aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT yaosun aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT zhuolinyang aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT jializhang aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT jiapengwang aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT weiwang aframeworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT qinzhihao frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT tengyujing frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT yaosun frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT zhuolinyang frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT jializhang frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT jiapengwang frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision AT weiwang frameworkofrecommendationsystemforunmannedaerialvehicleautonomousmaneuverdecision |