An Improvement of Static Subtree Partitioning in Metadata Server Cluster

Efficient metadata management is a key issue in distributed file systems. Currently a single metadata server (MDS) was used to provide metadata service in many distributed file systems. As a result the MDS is likely to be the bottleneck of the system with the expanding scale. To deal with this probl...

Full description

Saved in:
Bibliographic Details
Main Authors: Tan Zhipeng, Zhou Wei, Sun Jianliang, Zhan Tian, Cui Jie
Format: Article
Language:English
Published: Wiley 2012-09-01
Series:International Journal of Distributed Sensor Networks
Online Access:https://doi.org/10.1155/2012/835616
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832553128160919552
author Tan Zhipeng
Zhou Wei
Sun Jianliang
Zhan Tian
Cui Jie
author_facet Tan Zhipeng
Zhou Wei
Sun Jianliang
Zhan Tian
Cui Jie
author_sort Tan Zhipeng
collection DOAJ
description Efficient metadata management is a key issue in distributed file systems. Currently a single metadata server (MDS) was used to provide metadata service in many distributed file systems. As a result the MDS is likely to be the bottleneck of the system with the expanding scale. To deal with this problem, MDS cluster has been advanced. There are subtree partitioning and hashing partitioning to realize MDS cluster and so on. In view of the strengths and weaknesses of the previous methods, the paper proposes a half-dynamic subtree strategy that supports the replication of metadata, the dynamic addition and failure recovery of MDS. Finally we implement it in the open source pNFS file system and demonstrate its high performance and availability.
format Article
id doaj-art-6ab3385087f64bdd82ed881d4f5e735b
institution Kabale University
issn 1550-1477
language English
publishDate 2012-09-01
publisher Wiley
record_format Article
series International Journal of Distributed Sensor Networks
spelling doaj-art-6ab3385087f64bdd82ed881d4f5e735b2025-02-03T05:55:23ZengWileyInternational Journal of Distributed Sensor Networks1550-14772012-09-01810.1155/2012/835616An Improvement of Static Subtree Partitioning in Metadata Server ClusterTan ZhipengZhou WeiSun JianliangZhan TianCui JieEfficient metadata management is a key issue in distributed file systems. Currently a single metadata server (MDS) was used to provide metadata service in many distributed file systems. As a result the MDS is likely to be the bottleneck of the system with the expanding scale. To deal with this problem, MDS cluster has been advanced. There are subtree partitioning and hashing partitioning to realize MDS cluster and so on. In view of the strengths and weaknesses of the previous methods, the paper proposes a half-dynamic subtree strategy that supports the replication of metadata, the dynamic addition and failure recovery of MDS. Finally we implement it in the open source pNFS file system and demonstrate its high performance and availability.https://doi.org/10.1155/2012/835616
spellingShingle Tan Zhipeng
Zhou Wei
Sun Jianliang
Zhan Tian
Cui Jie
An Improvement of Static Subtree Partitioning in Metadata Server Cluster
International Journal of Distributed Sensor Networks
title An Improvement of Static Subtree Partitioning in Metadata Server Cluster
title_full An Improvement of Static Subtree Partitioning in Metadata Server Cluster
title_fullStr An Improvement of Static Subtree Partitioning in Metadata Server Cluster
title_full_unstemmed An Improvement of Static Subtree Partitioning in Metadata Server Cluster
title_short An Improvement of Static Subtree Partitioning in Metadata Server Cluster
title_sort improvement of static subtree partitioning in metadata server cluster
url https://doi.org/10.1155/2012/835616
work_keys_str_mv AT tanzhipeng animprovementofstaticsubtreepartitioninginmetadataservercluster
AT zhouwei animprovementofstaticsubtreepartitioninginmetadataservercluster
AT sunjianliang animprovementofstaticsubtreepartitioninginmetadataservercluster
AT zhantian animprovementofstaticsubtreepartitioninginmetadataservercluster
AT cuijie animprovementofstaticsubtreepartitioninginmetadataservercluster
AT tanzhipeng improvementofstaticsubtreepartitioninginmetadataservercluster
AT zhouwei improvementofstaticsubtreepartitioninginmetadataservercluster
AT sunjianliang improvementofstaticsubtreepartitioninginmetadataservercluster
AT zhantian improvementofstaticsubtreepartitioninginmetadataservercluster
AT cuijie improvementofstaticsubtreepartitioninginmetadataservercluster