Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks
Power management in wireless sensor networks is very important due to the limited energy of batteries. Sensor nodes with harvesters can extract energy from environmental sources as supplemental energy to break this limitation. In a clustered solar-powered sensor network where nodes in the network ar...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-04-01
|
| Series: | International Journal of Distributed Sensor Networks |
| Online Access: | https://doi.org/10.1177/15501477211007411 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832547287839014912 |
|---|---|
| author | Yujia Ge Yurong Nan Xianhai Guo |
| author_facet | Yujia Ge Yurong Nan Xianhai Guo |
| author_sort | Yujia Ge |
| collection | DOAJ |
| description | Power management in wireless sensor networks is very important due to the limited energy of batteries. Sensor nodes with harvesters can extract energy from environmental sources as supplemental energy to break this limitation. In a clustered solar-powered sensor network where nodes in the network are grouped into clusters, data collected by cluster members are sent to their cluster head and finally transmitted to the base station. The goal of the whole network is to maintain an energy neutrality state and to maximize the effective data throughput of the network. This article proposes an adaptive power manager based on cooperative reinforcement learning methods for the solar-powered wireless sensor networks to keep harvested energy more balanced among the whole clustered network. The cooperative strategy of Q -learning and SARSA( λ ) is applied in this multi-agent environment based on the node residual energy, the predicted harvested energy for the next time slot, and cluster head energy information. The node takes action accordingly to adjust its operating duty cycle. Experiments show that cooperative reinforcement learning methods can achieve the overall goal of maximizing network throughput and cooperative approaches outperform tuned static and non-cooperative approaches in clustered wireless sensor network applications. Experiments also show that the approach is effective in response to changes in the environment, changes in its parameters, and application-level quality of service requirements. |
| format | Article |
| id | doaj-art-625513cbd7e3443c9d9671aedc6007d0 |
| institution | Kabale University |
| issn | 1550-1477 |
| language | English |
| publishDate | 2021-04-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Journal of Distributed Sensor Networks |
| spelling | doaj-art-625513cbd7e3443c9d9671aedc6007d02025-02-03T06:45:21ZengWileyInternational Journal of Distributed Sensor Networks1550-14772021-04-011710.1177/15501477211007411Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networksYujia Ge0Yurong Nan1Xianhai Guo2School of Computer and Information Engineering, Zhejiang Gongshang University, Hangzhou, ChinaCollege of Information Engineering, Zhejiang University of Technology, Hangzhou, ChinaDepartment of Computer Science and Technology, Taizhou University, Taizhou, ChinaPower management in wireless sensor networks is very important due to the limited energy of batteries. Sensor nodes with harvesters can extract energy from environmental sources as supplemental energy to break this limitation. In a clustered solar-powered sensor network where nodes in the network are grouped into clusters, data collected by cluster members are sent to their cluster head and finally transmitted to the base station. The goal of the whole network is to maintain an energy neutrality state and to maximize the effective data throughput of the network. This article proposes an adaptive power manager based on cooperative reinforcement learning methods for the solar-powered wireless sensor networks to keep harvested energy more balanced among the whole clustered network. The cooperative strategy of Q -learning and SARSA( λ ) is applied in this multi-agent environment based on the node residual energy, the predicted harvested energy for the next time slot, and cluster head energy information. The node takes action accordingly to adjust its operating duty cycle. Experiments show that cooperative reinforcement learning methods can achieve the overall goal of maximizing network throughput and cooperative approaches outperform tuned static and non-cooperative approaches in clustered wireless sensor network applications. Experiments also show that the approach is effective in response to changes in the environment, changes in its parameters, and application-level quality of service requirements.https://doi.org/10.1177/15501477211007411 |
| spellingShingle | Yujia Ge Yurong Nan Xianhai Guo Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks International Journal of Distributed Sensor Networks |
| title | Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks |
| title_full | Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks |
| title_fullStr | Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks |
| title_full_unstemmed | Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks |
| title_short | Maximizing network throughput by cooperative reinforcement learning in clustered solar-powered wireless sensor networks |
| title_sort | maximizing network throughput by cooperative reinforcement learning in clustered solar powered wireless sensor networks |
| url | https://doi.org/10.1177/15501477211007411 |
| work_keys_str_mv | AT yujiage maximizingnetworkthroughputbycooperativereinforcementlearninginclusteredsolarpoweredwirelesssensornetworks AT yurongnan maximizingnetworkthroughputbycooperativereinforcementlearninginclusteredsolarpoweredwirelesssensornetworks AT xianhaiguo maximizingnetworkthroughputbycooperativereinforcementlearninginclusteredsolarpoweredwirelesssensornetworks |