A randomized block policy gradient algorithm with differential privacy in Content Centric Networks

Policy gradient methods are effective means to solve the problems of mobile multimedia data transmission in Content Centric Networks. Current policy gradient algorithms impose high computational cost in processing high-dimensional data. Meanwhile, the issue of privacy disclosure has not been taken i...

Full description

Saved in:
Bibliographic Details
Main Authors: Lin Wang, Xingang Xu, Xuhui Zhao, Baozhu Li, Ruijuan Zheng, Qingtao Wu
Format: Article
Language:English
Published: Wiley 2021-12-01
Series:International Journal of Distributed Sensor Networks
Online Access:https://doi.org/10.1177/15501477211059934
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832547196560474112
author Lin Wang
Xingang Xu
Xuhui Zhao
Baozhu Li
Ruijuan Zheng
Qingtao Wu
author_facet Lin Wang
Xingang Xu
Xuhui Zhao
Baozhu Li
Ruijuan Zheng
Qingtao Wu
author_sort Lin Wang
collection DOAJ
description Policy gradient methods are effective means to solve the problems of mobile multimedia data transmission in Content Centric Networks. Current policy gradient algorithms impose high computational cost in processing high-dimensional data. Meanwhile, the issue of privacy disclosure has not been taken into account. However, privacy protection is important in data training. Therefore, we propose a randomized block policy gradient algorithm with differential privacy. In order to reduce computational complexity when processing high-dimensional data, we randomly select a block coordinate to update the gradients at each round. To solve the privacy protection problem, we add a differential privacy protection mechanism to the algorithm, and we prove that it preserves the ε -privacy level. We conduct extensive simulations in four environments, which are CartPole, Walker, HalfCheetah, and Hopper. Compared with the methods such as important-sampling momentum-based policy gradient, Hessian-Aided momentum-based policy gradient, REINFORCE, the experimental results of our algorithm show a faster convergence rate than others in the same environment.
format Article
id doaj-art-0622e0a92fe642be8c3319f113f53471
institution Kabale University
issn 1550-1477
language English
publishDate 2021-12-01
publisher Wiley
record_format Article
series International Journal of Distributed Sensor Networks
spelling doaj-art-0622e0a92fe642be8c3319f113f534712025-02-03T06:45:37ZengWileyInternational Journal of Distributed Sensor Networks1550-14772021-12-011710.1177/15501477211059934A randomized block policy gradient algorithm with differential privacy in Content Centric NetworksLin Wang0Xingang Xu1Xuhui Zhao2Baozhu Li3Ruijuan Zheng4Qingtao Wu5School of Information Engineering, Henan University of Science and Technology, Luoyang, ChinaSchool of Information Engineering, Henan University of Science and Technology, Luoyang, ChinaSchool of Information Engineering, Henan University of Science and Technology, Luoyang, ChinaInternet of Things & Smart City Innovation Platform, Zhuhai Fudan Innovation Institute, Zhuhai, ChinaSchool of Information Engineering, Henan University of Science and Technology, Luoyang, ChinaSchool of Information Engineering, Henan University of Science and Technology, Luoyang, ChinaPolicy gradient methods are effective means to solve the problems of mobile multimedia data transmission in Content Centric Networks. Current policy gradient algorithms impose high computational cost in processing high-dimensional data. Meanwhile, the issue of privacy disclosure has not been taken into account. However, privacy protection is important in data training. Therefore, we propose a randomized block policy gradient algorithm with differential privacy. In order to reduce computational complexity when processing high-dimensional data, we randomly select a block coordinate to update the gradients at each round. To solve the privacy protection problem, we add a differential privacy protection mechanism to the algorithm, and we prove that it preserves the ε -privacy level. We conduct extensive simulations in four environments, which are CartPole, Walker, HalfCheetah, and Hopper. Compared with the methods such as important-sampling momentum-based policy gradient, Hessian-Aided momentum-based policy gradient, REINFORCE, the experimental results of our algorithm show a faster convergence rate than others in the same environment.https://doi.org/10.1177/15501477211059934
spellingShingle Lin Wang
Xingang Xu
Xuhui Zhao
Baozhu Li
Ruijuan Zheng
Qingtao Wu
A randomized block policy gradient algorithm with differential privacy in Content Centric Networks
International Journal of Distributed Sensor Networks
title A randomized block policy gradient algorithm with differential privacy in Content Centric Networks
title_full A randomized block policy gradient algorithm with differential privacy in Content Centric Networks
title_fullStr A randomized block policy gradient algorithm with differential privacy in Content Centric Networks
title_full_unstemmed A randomized block policy gradient algorithm with differential privacy in Content Centric Networks
title_short A randomized block policy gradient algorithm with differential privacy in Content Centric Networks
title_sort randomized block policy gradient algorithm with differential privacy in content centric networks
url https://doi.org/10.1177/15501477211059934
work_keys_str_mv AT linwang arandomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT xingangxu arandomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT xuhuizhao arandomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT baozhuli arandomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT ruijuanzheng arandomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT qingtaowu arandomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT linwang randomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT xingangxu randomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT xuhuizhao randomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT baozhuli randomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT ruijuanzheng randomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks
AT qingtaowu randomizedblockpolicygradientalgorithmwithdifferentialprivacyincontentcentricnetworks