An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network
With the rapid development of IoT technology, sensors are widely used for monitoring environmental parameters. The data collected by sensors needs to be stored, and distributed storage systems provide an excellent platform to handle this vast amount of data. To enhance data reliability and reduce st...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/25/2/346 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832587613539663872 |
|---|---|
| author | Ying Song Jialin Liu Yingai Tian Bo Wang |
| author_facet | Ying Song Jialin Liu Yingai Tian Bo Wang |
| author_sort | Ying Song |
| collection | DOAJ |
| description | With the rapid development of IoT technology, sensors are widely used for monitoring environmental parameters. The data collected by sensors needs to be stored, and distributed storage systems provide an excellent platform to handle this vast amount of data. To enhance data reliability and reduce storage costs, erasure coding technology can be employed within distributed storage systems. However, the process of recovering lost or damaged data inevitably generates significant cross-rack traffic. In recent years, various batch recovery methods have been designed to improve data recovery speed and reduce cross-rack recovery traffic, but they have limitations in different aspects, such as less consideration for heterogeneous cross-rack bandwidth and insufficient handling of recovery link scheduling. This paper proposes the HBRepair recovery framework, aimed at improving data recovery speed by balancing the recovery load and reducing cross-rack recovery traffic. Firstly, HBRepair strategically selects helper blocks and nodes for storing recovery blocks to find the optimal batch recovery plan. Then, it selectively and rationally schedules recovery links to saturate idle bandwidth resources and avoid network congestion. Experimental results show that by optimizing the use of cross-rack bandwidth, HBRepair can reduce cross-rack recovery time by up to 26.74%, effectively addressing the shortcomings of existing methods. |
| format | Article |
| id | doaj-art-fc7ba9844ce449b392d586cba5a0c6a4 |
| institution | Kabale University |
| issn | 1424-8220 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-fc7ba9844ce449b392d586cba5a0c6a42025-01-24T13:48:35ZengMDPI AGSensors1424-82202025-01-0125234610.3390/s25020346An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous NetworkYing Song0Jialin Liu1Yingai Tian2Bo Wang3School of Computer Science, Beijing Information Science and Technology University, Beijing 102206, ChinaSchool of Computer Science, Beijing Information Science and Technology University, Beijing 102206, ChinaSchool of Computer Science, Beijing Information Science and Technology University, Beijing 102206, ChinaSoftware Engineering College, Zhengzhou University of Light Industry, Zhengzhou 450002, ChinaWith the rapid development of IoT technology, sensors are widely used for monitoring environmental parameters. The data collected by sensors needs to be stored, and distributed storage systems provide an excellent platform to handle this vast amount of data. To enhance data reliability and reduce storage costs, erasure coding technology can be employed within distributed storage systems. However, the process of recovering lost or damaged data inevitably generates significant cross-rack traffic. In recent years, various batch recovery methods have been designed to improve data recovery speed and reduce cross-rack recovery traffic, but they have limitations in different aspects, such as less consideration for heterogeneous cross-rack bandwidth and insufficient handling of recovery link scheduling. This paper proposes the HBRepair recovery framework, aimed at improving data recovery speed by balancing the recovery load and reducing cross-rack recovery traffic. Firstly, HBRepair strategically selects helper blocks and nodes for storing recovery blocks to find the optimal batch recovery plan. Then, it selectively and rationally schedules recovery links to saturate idle bandwidth resources and avoid network congestion. Experimental results show that by optimizing the use of cross-rack bandwidth, HBRepair can reduce cross-rack recovery time by up to 26.74%, effectively addressing the shortcomings of existing methods.https://www.mdpi.com/1424-8220/25/2/346bandwidth managementload balancingdistributed storage systemheterogeneous networkerasure codingbatch recovery |
| spellingShingle | Ying Song Jialin Liu Yingai Tian Bo Wang An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network Sensors bandwidth management load balancing distributed storage system heterogeneous network erasure coding batch recovery |
| title | An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network |
| title_full | An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network |
| title_fullStr | An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network |
| title_full_unstemmed | An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network |
| title_short | An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network |
| title_sort | optimized method for batch recovery based on erasure coding in heterogeneous network |
| topic | bandwidth management load balancing distributed storage system heterogeneous network erasure coding batch recovery |
| url | https://www.mdpi.com/1424-8220/25/2/346 |
| work_keys_str_mv | AT yingsong anoptimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT jialinliu anoptimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT yingaitian anoptimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT bowang anoptimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT yingsong optimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT jialinliu optimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT yingaitian optimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork AT bowang optimizedmethodforbatchrecoverybasedonerasurecodinginheterogeneousnetwork |