Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing

Smart vehicles are increasingly equipped with advanced sensors and computational resources which enable them to detect surroundings and enhance driving safety. VEoTC (Vehicular Edge of Things Computing) solutions aim to exploit these embedded sensors and resources to provide computational services t...

Full description

Saved in:
Bibliographic Details
Main Authors: Ghada Afifi, Bassem Mokhtar
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Open Journal of Vehicular Technology
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11045983/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849718607381004288
author Ghada Afifi
Bassem Mokhtar
author_facet Ghada Afifi
Bassem Mokhtar
author_sort Ghada Afifi
collection DOAJ
description Smart vehicles are increasingly equipped with advanced sensors and computational resources which enable them to detect surroundings and enhance driving safety. VEoTC (Vehicular Edge of Things Computing) solutions aim to exploit these embedded sensors and resources to provide computational services to other users. VEoTC can enhance the Quality of Experience (QoE) of vehicle and mobile users requesting computational tasks by providing context-aware services closer to the users that are otherwise not easily accessible in real time. Additionally, such solutions can extend the computational coverage to areas lacking Roadside Unit (RSU) infrastructure. However, VEoTC frameworks face several challenges in effectively localizing and allocating the distributed resources and offloading tasks successfully due to the high mobility of vehicles and fluctuating user densities. The paper proposes a distributed Machine Learning (ML)-based solution which optimizes task scheduling to smart vehicles and/or RSUs through joint resource allocation and task offloading. We formulate a belief-based optimization problem to maximize the QoE of vehicular users while providing performance guarantees that account for geospatial uncertainty associated with the availability of embedded resources. We propose a Deep Reinforcement Learning (DRL)-based solution to solve the formulated problem in real-time adapting to the dynamic network conditions. We analyze the performance of the proposed approach as compared to benchmark optimization and other ML-based techniques. Furthermore, we conduct hardware-based field test experiments to verify the effectiveness of our proposed algorithm to satisfy the stringent real-time latency requirements for various vehicular applications. According to our extensive simulation and experimental results, the proposed solution has the potential to satisfy the stringent QoE guarantees required for critical road safety applications.
format Article
id doaj-art-1a3e64d760a14c9fa65e4dc4a31dbfab
institution DOAJ
issn 2644-1330
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of Vehicular Technology
spelling doaj-art-1a3e64d760a14c9fa65e4dc4a31dbfab2025-08-20T03:12:20ZengIEEEIEEE Open Journal of Vehicular Technology2644-13302025-01-0161796181410.1109/OJVT.2025.358203511045983Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things ComputingGhada Afifi0https://orcid.org/0000-0002-2136-3586Bassem Mokhtar1https://orcid.org/0000-0002-7138-4721College of Information Technology, UAE University, Al Ain, UAECollege of Information Technology, UAE University, Al Ain, UAESmart vehicles are increasingly equipped with advanced sensors and computational resources which enable them to detect surroundings and enhance driving safety. VEoTC (Vehicular Edge of Things Computing) solutions aim to exploit these embedded sensors and resources to provide computational services to other users. VEoTC can enhance the Quality of Experience (QoE) of vehicle and mobile users requesting computational tasks by providing context-aware services closer to the users that are otherwise not easily accessible in real time. Additionally, such solutions can extend the computational coverage to areas lacking Roadside Unit (RSU) infrastructure. However, VEoTC frameworks face several challenges in effectively localizing and allocating the distributed resources and offloading tasks successfully due to the high mobility of vehicles and fluctuating user densities. The paper proposes a distributed Machine Learning (ML)-based solution which optimizes task scheduling to smart vehicles and/or RSUs through joint resource allocation and task offloading. We formulate a belief-based optimization problem to maximize the QoE of vehicular users while providing performance guarantees that account for geospatial uncertainty associated with the availability of embedded resources. We propose a Deep Reinforcement Learning (DRL)-based solution to solve the formulated problem in real-time adapting to the dynamic network conditions. We analyze the performance of the proposed approach as compared to benchmark optimization and other ML-based techniques. Furthermore, we conduct hardware-based field test experiments to verify the effectiveness of our proposed algorithm to satisfy the stringent real-time latency requirements for various vehicular applications. According to our extensive simulation and experimental results, the proposed solution has the potential to satisfy the stringent QoE guarantees required for critical road safety applications.https://ieeexplore.ieee.org/document/11045983/Computing resource geofencingresource allocationtask offloadingvehicular edge of things computingdeep reinforcement learning
spellingShingle Ghada Afifi
Bassem Mokhtar
Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing
IEEE Open Journal of Vehicular Technology
Computing resource geofencing
resource allocation
task offloading
vehicular edge of things computing
deep reinforcement learning
title Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing
title_full Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing
title_fullStr Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing
title_full_unstemmed Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing
title_short Distributed RL-Based Resource Allocation and Task Offloading for Vehicular Edge of Things Computing
title_sort distributed rl based resource allocation and task offloading for vehicular edge of things computing
topic Computing resource geofencing
resource allocation
task offloading
vehicular edge of things computing
deep reinforcement learning
url https://ieeexplore.ieee.org/document/11045983/
work_keys_str_mv AT ghadaafifi distributedrlbasedresourceallocationandtaskoffloadingforvehicularedgeofthingscomputing
AT bassemmokhtar distributedrlbasedresourceallocationandtaskoffloadingforvehicularedgeofthingscomputing