Abstract
We present a power-saving method for large-scale distributed storage systems of Internet hosting services, whose prime example is a video/photo sharing service. The idea behind our method is to periodically exchange stored data among disks in an autonomous way so as to skew the workload towards a small number of disks while not overloading them. The objective of this paper is to explore a power-saving method that is adaptable to both constant massive influx of data and changes in data popularity. The performance is measured both in simulation and prototype implementation using a real access pattern of 20,000 public photos on Flickr. In the experiments, we observed that our method saved 14.5–39.7% of energy, while the overall average response time was 133 ms, where 6.8–19.1% of total accesses were of disks in low-power mode.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Colarelli, D., Grunwald, D.: Massive arrays of idle disks for storage archives. In: ACM/IEEE Conference on Supercomputing, pp. 1–11 (2002)
Harnik, D., Naor, D., Segall, I.: Low power mode in cloud storage systems. In: Parallel and Distributed Processing Symposium, International, pp. 1–8 (2009)
Hasebe, K., Niwa, T., Sugiki, A., Kato, K.: Power-Saving in Large-Scale Storage Systems with Data Migration. In: IEEE International Conference on Cloud Computing Technology and Science (CloudCom 2010), pp. 266–273 (2010)
Kaushik, R.T., Bhandarkar, M.: GreenHDFS: towards an energy-conserving, storage-efficient, hybrid Hadoop compute cluster. In: 2010 International Conference on Power Aware Computing and Systems (HotPower 2010), pp. 1–9 (2010)
Pinheiro, E., Bianchini, R.: Energy conservation techniques for disk array-based servers. In: International Conference on Supercomputing, pp. 68–78 (2004)
Pinheiro, E., Bianchini, R., Dubnicki, C.: Exploiting redundancy to conserve energy in storage systems. In: ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pp. 15–26 (2006)
Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup service for internet applications. In: ACM SIGCOMM, pp. 149–160 (2001)
Storer, M., Greenan, K., Miller, E., Voruganti, K.: Pergamum: Replacing tape with energy efficient reliable, disk-based archival storage. In: USENIX Conference on File and Storage Technologies (FAST 2008), pp. 1–16 (2008)
Verma, A., Koller, R., Useche, L., Rangaswami, R.: SRCMap: energy proportional storage using dynamic consolidation. In: 8th USENIX Conference on File and Storage Technologies (FAST 2010), pp. 154–168 (2010)
Vrbsky, S.V., Lei, M., Smith, K., Byrd, J.: Data Replication and Power Consumption in Data Grids. In: 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom 2010), pp. 288–295 (2010)
Weddle, C., Oldham, M., Qian, J., Wang, A., Reiher, P., Kuenning, G.: PARAID: A gear-shifting power-aware RAID. In: USENIX Conference on File and Storage Technologies (FAST 2007), pp. 245–260 (2007)
Yao, X., Wang, J.: RIMAC: a novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems. In: ACM SIGOPS/EuroSys European Conference on Computer Systems, pp. 249–262 (2006)
Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., Wilkes, J.: Hibernator: helping disk arrays sleep through the winter. In: ACM Symposium on Operating Systems Principles, pp. 177–190 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Okoshi, J., Hasebe, K., Kato, K. (2013). Power-Aware Autonomous Distributed Storage Systems for Internet Hosting Service Platforms. In: Yousif, M., Schubert, L. (eds) Cloud Computing. CloudComp 2012. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 112. Springer, Cham. https://doi.org/10.1007/978-3-319-03874-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-03874-2_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03873-5
Online ISBN: 978-3-319-03874-2
eBook Packages: Computer ScienceComputer Science (R0)