Affiliation:
1. Department of Convergence Electronic Engineering, Sangmyung University, Seoul 03016, Republic of Korea
2. Department of Game Design and Development, Sangmyung University, Seoul 03016, Republic of Korea
Abstract
Recently, decentralized file systems are widely used to overcome centralized file systems’ load asymmetry between nodes and the scalability problem. Due to the lack of a metadata server, decentralized systems require more RPC requests to control metadata processing between clients and servers, which adversely impacts the I/O performance and traffic imbalance by increasing RPC latency. In this paper, we propose an efficient I/O scheme to reduce the RPC overhead in decentralized file systems. Instead of sending a single RPC request at a time, we enqueued the RPCs in the global queue and merged them into larger RPC requests, thus avoiding excessive RPC latency overheads. The experimental results showed that our scheme improves write and read performance by up to 13% and 16%, respectively, compared with those of the original.
Subject
Physics and Astronomy (miscellaneous),General Mathematics,Chemistry (miscellaneous),Computer Science (miscellaneous)
Reference27 articles.
1. Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3–7). The Hadoop Distributed File System. Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), Incline Village, NV, USA.
2. Schwan, P. (2003, January 23–26). Lustre: Building a file system for 1000-node clusters. Proceedings of the 2003 Linux Symposium, Ottawa, ON, Canada.
3. Depardon, B., Mahec, G.L., and Séguin, C. (2021, November 19). Analysis of Six Distributed File Systems; Technical Report; HAL. Available online: https://hal.inria.fr/hal-00789086.
4. Welch, B., and Noer, G. (2013, January 6–10). Optimizing a hybrid SSD/HDD HPC storage system based on file size distributions. Proceedings of the IEEE 29th Symposium Mass Storage Systems and Technologies, Long Beach, CA, USA.
5. The State of the Art of Metadata Managements in Large-Scale Distributed File Systems—Scalability, Performance and Availability;Dai;IEEE Trans. Parallel Distrib. Syst.,2022
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
1. Efficient Asynchronous I/O with Request Merging;2023 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW);2023-05