Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks

The problem of region of interest (RoI) extraction and transmission of video frames captured in edge-assisted unmanned aerial vehicle (UAV) systems was investigated to improve the inference performance of patrolling tasks. Due to the limited UAV onboard computational resources, a lightweight RoI ext...

Full description

Saved in:
Bibliographic Details
Main Authors: YANG Peng, LIANG Yuxin, KONG Yuxin, LIU Mingliu
Format: Article
Language:zho
Published: China InfoCom Media Group 2024-12-01
Series:物联网学报
Subjects:
Online Access:http://www.wlwxb.com.cn/zh/article/doi/10.11959/j.issn.2096-3750.2024.00418/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832586353978638336
author YANG Peng
LIANG Yuxin
KONG Yuxin
LIU Mingliu
author_facet YANG Peng
LIANG Yuxin
KONG Yuxin
LIU Mingliu
author_sort YANG Peng
collection DOAJ
description The problem of region of interest (RoI) extraction and transmission of video frames captured in edge-assisted unmanned aerial vehicle (UAV) systems was investigated to improve the inference performance of patrolling tasks. Due to the limited UAV onboard computational resources, a lightweight RoI extraction method based on class activation mapping (CAM) was proposed, which was able to rapidly locate areas containing patrolling targets. Those RoIs were then transmitted to edge servers for further processing. To address the challenges from dynamic UAV trajectories and fluctuating network conditions, the RoIs collected by UAVs were properly choosen through an adaptive RoI box selection algorithm, followed by adaptive configuration of quantization parameters (QP) of video codec, in order to further compress the transmitted data volume. A joint optimization problem was thus formulated for RoI box selection and adaptive coding configuration, which was solved via a heuristic algorithm. Experimental results demonstrate that, the proposed approach can effectively improve the detection accuracy of patrolling tasks, reduce data transmission volume, and significantly lower system latency, indicating great potential in UAV-based patrolling applications.
format Article
id doaj-art-915d1a8578db46ce8ada37a5380f63c4
institution Kabale University
issn 2096-3750
language zho
publishDate 2024-12-01
publisher China InfoCom Media Group
record_format Article
series 物联网学报
spelling doaj-art-915d1a8578db46ce8ada37a5380f63c42025-01-25T19:00:24ZzhoChina InfoCom Media Group物联网学报2096-37502024-12-01812913979606167Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasksYANG PengLIANG YuxinKONG YuxinLIU MingliuThe problem of region of interest (RoI) extraction and transmission of video frames captured in edge-assisted unmanned aerial vehicle (UAV) systems was investigated to improve the inference performance of patrolling tasks. Due to the limited UAV onboard computational resources, a lightweight RoI extraction method based on class activation mapping (CAM) was proposed, which was able to rapidly locate areas containing patrolling targets. Those RoIs were then transmitted to edge servers for further processing. To address the challenges from dynamic UAV trajectories and fluctuating network conditions, the RoIs collected by UAVs were properly choosen through an adaptive RoI box selection algorithm, followed by adaptive configuration of quantization parameters (QP) of video codec, in order to further compress the transmitted data volume. A joint optimization problem was thus formulated for RoI box selection and adaptive coding configuration, which was solved via a heuristic algorithm. Experimental results demonstrate that, the proposed approach can effectively improve the detection accuracy of patrolling tasks, reduce data transmission volume, and significantly lower system latency, indicating great potential in UAV-based patrolling applications.http://www.wlwxb.com.cn/zh/article/doi/10.11959/j.issn.2096-3750.2024.00418/UAV communicationmobile edge computingRoI extractionvideo coding
spellingShingle YANG Peng
LIANG Yuxin
KONG Yuxin
LIU Mingliu
Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks
物联网学报
UAV communication
mobile edge computing
RoI extraction
video coding
title Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks
title_full Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks
title_fullStr Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks
title_full_unstemmed Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks
title_short Edge-assisted UAV onboard video compression and transmission for efficient inference of patrolling tasks
title_sort edge assisted uav onboard video compression and transmission for efficient inference of patrolling tasks
topic UAV communication
mobile edge computing
RoI extraction
video coding
url http://www.wlwxb.com.cn/zh/article/doi/10.11959/j.issn.2096-3750.2024.00418/
work_keys_str_mv AT yangpeng edgeassisteduavonboardvideocompressionandtransmissionforefficientinferenceofpatrollingtasks
AT liangyuxin edgeassisteduavonboardvideocompressionandtransmissionforefficientinferenceofpatrollingtasks
AT kongyuxin edgeassisteduavonboardvideocompressionandtransmissionforefficientinferenceofpatrollingtasks
AT liumingliu edgeassisteduavonboardvideocompressionandtransmissionforefficientinferenceofpatrollingtasks