Enhancing Channel Selection in 5G with Decentralized Federated Multi-Agent Deep Reinforcement Learning

The increasing popularity of vehicular communication systems necessitates efficient and autonomous decision-making to address the challenges of vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communications. In this paper, we present a comprehensive study on channelization in Cellular V...

Full description

Saved in:
Bibliographic Details
Main Authors: Taghi Shahgholi, Keyhan Khamforoosh, Amir Sheikhahmadi, Sadoon Azizi
Format: Article
Language:English
Published: Ferdowsi University of Mashhad 2024-12-01
Series:Computer and Knowledge Engineering
Subjects:
Online Access:https://cke.um.ac.ir/article_45826_5014363e0f68262f4593f908220dec1b.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The increasing popularity of vehicular communication systems necessitates efficient and autonomous decision-making to address the challenges of vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communications. In this paper, we present a comprehensive study on channelization in Cellular Vehicle-to-Everything (C-V2X) communication and propose a novel two-layer multi-agent approach that integrates deep reinforcement learning (DRL) and federated learning (FL) to enhance the decision-making process in channel utilization.Our approach leverages the autonomy of each vehicle, treating it as an independent agent capable of making channel selection decisions based on its local observations in its own cluster. Simultaneously, a centralized architecture coordinates nearby vehicles to optimize overall system performance. The DRL-based decision-making model considers crucial factors, such as instantaneous channel state information and historical link selections, to dynamically allocate channels and transmission power, leading to improved system efficiency.By incorporating federated learning, we enable knowledge sharing and synchronization among the decentralized vehicular agents. This collaborative approach harnesses the collective intelligence of the network, empowering each agent to gain insights into the broader network dynamics beyond its limited observations. The results of our extensive simulations demonstrate the superiority of the proposed approach over existing methods, as it achieves higher data rates, success rates, and superior interference mitigation.
ISSN:2538-5453
2717-4123