Skip to main content

Development of an Algorithm for Energy Efficient Resource Scheduling of a Multi-cloud Platform for Big Data Processing

  • Conference paper
  • First Online:
Advances in Artificial Systems for Medicine and Education V (AIMEE 2021)

Abstract

The problem of optimal distribution of virtual resources in multi-cloud systems for big data processing is relevant to this day. End users want to access virtual resources as soon as possible using one of the existing content distribution models: virtual desktop as a service, specific software as a service or even infrastructure as a service. The cloud system scheduler can handle incoming requests from users in physical constraints, taking into account the reduction of energy consumption and limited resources of cloud system. Violation of the Service Level Agreement in terms of exceeding the response time can lead to penalty for the service owner. This paper formalized the optimization problem of close to optimal energy efficient scheduling and provided general architecture of cloud platform under consideration. On the basis of the evolutionary annealing simulation algorithm, a cloud system simulator is implemented. Conducted experimental studies have shown the effectiveness of the proposed method in comparison with the greedy algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Yan, J., et al.: Industrial big data in an industry 4.0 environment: challenges, schemes, and applications for predictive maintenance. IEEE Access 05, 23484–23491 (2017)

    Article  Google Scholar 

  2. Liu, Y., et al.: High-efficient energy saving processing of big data of communication under mobile cloud computing. Int. J. Model. Simul. Sci. Comput. 10(04), 1–11 (2019)

    Article  Google Scholar 

  3. Cordeschi, N., et al.: Energy-saving QoS resource management of virtualized networked data centers for big data stream computing. In: Emerging Research in Cloud Distributed Computing Systems, pp. 122–155. IGI Global (2015)

    Google Scholar 

  4. Ahmad, B., et al.: Economic impact of energy saving techniques in cloud server. Cluster Comput. 23, 611–621 (2020)

    Article  Google Scholar 

  5. Arora, S., Bala, A.: A survey: ICT enabled energy efficiency techniques for big data applications. Cluster Comput. 23, 775–796 (2020)

    Article  Google Scholar 

  6. Yang, C.T., Wan, T.Y.: Implementation of an energy saving cloud infrastructure with virtual machine power usage monitoring and live migration on OpenStack. Computing 102(6), 1547–1566 (2020)

    Article  Google Scholar 

  7. Wu, W.T., et al.: Energy-efficient Hadoop for big data analytics and computing: a systematic review and research insights. Future Gener. Comput. Syst. 86, 1351–1367 (2018)

    Article  Google Scholar 

  8. Banka, K., et al.: A study of state-of-the-art energy saving on edges. In: Proceedings of the 2021 ACM Southeast Conference, pp. 224–228 (2021)

    Google Scholar 

  9. Yang, C.T., et al.: An energy-efficient cloud system with novel dynamic resource allocation methods. J. Supercomput. 75(8), 4408–4429 (2019)

    Article  Google Scholar 

  10. Qu, Z., et al.: Study QoS optimization and energy saving techniques in cloud, fog, edge, and IoT. Complexity 2020, 1–16 (2020)

    Google Scholar 

  11. Copil, G., et al.: Cloud SLA negotiation for energy saving—a particle swarm optimization approach. In: 2012 IEEE 8th International Conference on Intelligent Computer Communication and Processing, pp. 289–296. IEEE (2012)

    Google Scholar 

  12. Tseng, C.W., et al.: NFV deployment strategies in SDN network. Int. J. High Perform. Comput. Netw. 14(2), 237–248 (2019)

    Article  Google Scholar 

  13. Li, X., et al.: Novel Resource and Energy Management for 5G integrated backhaul/fronthaul (5G-Crosshaul). In: 2017 IEEE International Conference on Communications Workshops (ICC Workshops), pp. 778–784. IEEE (2017)

    Google Scholar 

  14. Dinh, N.T., Kim, Y.: An efficient availability guaranteed deployment scheme for IoT service chains over fog-core cloud networks. Sensors 18(11), 3970 (2018)

    Article  Google Scholar 

  15. Dalla-Costa, A.G., et al.: Maestro: an NFV orchestrator for wireless environments aware of VNF internal compositions. In: 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA), pp. 484–491. IEEE (2017)

    Google Scholar 

  16. Soulegan, N.S., Barekatain, B., Neysiani, B.S.: MTC: minimizing time and cost of cloud task scheduling based on customers and providers needs using genetic algorithm. Int. J. Intell. Syst. Appl. (IJISA) 02, 38–51 (2021)

    Google Scholar 

  17. Sahana, S.K.: An automated parameter tuning method for ant colony optimization for scheduling jobs in grid environment. Int. J. Intell. Syst. Appl. (IJISA) 03, 11–21 (2019)

    Google Scholar 

Download references

Acknowledgment

The reported study was funded by RFBR (№ 20–07-01065), and by a grant of the President of the Russian Federation (NSh-2502.2020.9).

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Legashev, L.V., Zabrodina, L.S., Parfenov, D.I., Bolodurina, I.P. (2022). Development of an Algorithm for Energy Efficient Resource Scheduling of a Multi-cloud Platform for Big Data Processing. In: Hu, Z., Petoukhov, S., He, M. (eds) Advances in Artificial Systems for Medicine and Education V. AIMEE 2021. Lecture Notes on Data Engineering and Communications Technologies, vol 107 . Springer, Cham. https://doi.org/10.1007/978-3-030-92537-6_10

Download citation

Publish with us

Policies and ethics