Abstract
At present, small files stored in most of the distributed storage systems account for a large proportion, how to improve the storage efficiency of small file has long been a hot issue in the academic community. In the existing methods, researchers usually integrate small files into content-related large files for association storage. The shortcoming is that if we read some small files in a large file, the entire large file must be read into the cache space, which greatly reduces the utilization of the cache space. To solve this defect, this paper designs a scheme based on the combination of cache replacement optimization algorithm and multi-level cache dynamic elimination mechanism. We compute the content heat value of the cache object by the cache replacement optimization algorithm, and then through the multi-level cache dynamic elimination mechanism we expel the object with low content heat value in the cache space to reserve enough space for the new arrived object. This proposed method not only improves the cache space utilization, but also increases the cache data search efficiency and hit rate. Series of experiments and their result show that the cache hit rate obtained by our proposed method is 14% higher than the LRU cache replacement algorithm and 52% higher than the LFU cache replacement algorithm, which can optimize the reading performance of small files based on Redis cache.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Weng, M., Shang, Y., Tian, Y.: The design and implementation of LRU-based web cache. In: 2013 8th International Conference on Communications and Networking in China, Guilin, China, pp. 400–404. IEEE (2014)
Hasslinger, G., Ntougias, K., Hasslinger, F., Hohlfeld, O.: Comparing web cache implementations for fast O(1) updates based on LRU, LFU and score gated strategies. In: 2018 IEEE 23rd International Workshop on Computer Aided Modeling and Design of Communication Links and Networks, Barcelona, Spain, pp. 1–7. IEEE (2018)
Herr, Q.P., Bunyk, P.: Implementation and application of first-in first-out buffers. IEEE Trans. Appl. Supercond. 13(2), 563–566 (2003)
Nagasako, Y., Yamaguchi, S.: A server cache size aware cache replacement algorithm for block level network Storage. In: 2011 Tenth International Symposium on Autonomous Decentralized Systems, Tokyo & Hiroshima, Japan, pp. 573–576. IEEE (2011)
Miao, F., Chen, D., Jin, L.: Multi-level PLRU cache algorithm for content delivery networks. In: 2017 10th International Symposium on Computational Intelligence and Design, Hangzhou, China, pp. 320–323. IEEE (2017)
Li, T., Li, Y.: A content popularity based cache replacement algorithm for NDN [EB/OL] (2019). http://www.paper.edu.cn/releasepaper/content/201212-897
Podlipnig, S., Böszörmenyi, L.: A survey of web cache replacement strategies. ACM Comput. Surv. 35(4), 374–398 (2003)
Jelenkovic, P.R., Radovanovic, A.: The persistent-access-caching algorithm. Random Struct. Algorithms 33(2), 219–251 (2008)
Acknowledgement
This work is supported by National Natural Science Foundation of China (Nos. 61861013, 61662018). Scientific Research and Technology Development Project of Guangxi (No. 1598019-2), Guangxi Natural Science Foundation of China (No. 2016GXNSFAA380153), the Doctoral Research Foundation of Guilin University of Electronic Science and Technology (No. UF19033Y), Guangxi Graduate Education Innovation Program (2019YCXS044).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wei, B., Deng, L., Fan, Y., Ye, M. (2020). Small File Read Performance Optimization Based on Redis Cache in Distributed Storage System. In: Pan, JS., Lin, JW., Liang, Y., Chu, SC. (eds) Genetic and Evolutionary Computing. ICGEC 2019. Advances in Intelligent Systems and Computing, vol 1107. Springer, Singapore. https://doi.org/10.1007/978-981-15-3308-2_38
Download citation
DOI: https://doi.org/10.1007/978-981-15-3308-2_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-3307-5
Online ISBN: 978-981-15-3308-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)