Skip to main content
SpringerLink
Log in

Scheduling Mechanisms in Serverless Computing

  • Chapter
  • First Online:
Serverless Computing: Principles and Paradigms

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 162))

Abstract

Currently, serverless computing is considered a critical event in the information and communication technologies domain. It provides a model with high scalability, pay-as-you-go, and a flexible approach to accessing requests using microservices. Many applications implement a microservice architecture, making them perform better than monolith architecture. Microservices are small pieces of code called functions, each of which can be used to run a series of processes. Consequently, microservices need the resources for execution. Hence, one of the critical issues is the efficient allocation of resources for microservices on the nodes, which are considered by structures called schedulers. Scheduling is the strategy of allocating tasks to resources in time. It increases the serverless domain’s performance and efficiency by maximizing resource utilization. This scheduling strategy has to consider restrictions specified by the serverless providers and the careers. Using the scheduler’s tasks and maintaining fairness between efficiency and the quality of careers service is complex. Scheduling algorithms are developed considering metrics similar to performance, priority, latency, cost, etc. Therefore, the process of resource allocation is regarded as a critical factor that can be of considerable significance to service providers. In serverless computing, service providers must ensure that their chosen scheduling strategies are satisfactory to service receivers. Although there are various scheduling techniques, it is crucial to point out that no single scheduling technique can accommodate all the requirements of various applicants. An in-depth understanding of the types of schedules and selecting the most effective scheduler for different kinds of applicant requirements is therefore crucial to provide the most efficient allocation of resources. In other words, when selected scheduling is inefficient, several problems can result both for the service provider and the service recipient. Therefore, service providers are forced to increase their costs. As a result, the cost of the applicants is increased. The consequences of this situation are that the requesters are dissatisfied with the poor quality service received and the increased cost they have and are less inclined to use a provider’s services in the future. Many scheduler strategies are available to providers; therefore, they should become familiar with a variety of them and understand their advantages, characteristics, and disadvantages. In this study, we comprehensively investigate the widely employed schedulers in serverless computing by investigating their advantages, disadvantages, and applications. The purpose of the present study is to present a comprehensive examination of various and effective scheduling techniques that can be a basis for selecting the appropriate scheduling process based on the providers’ approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Mustafa S, Nazir B, Hayat A, Madani SA (2015) Resource management in cloud computing: taxonomy, prospects, and challenges. Comput Electr Eng 47:186–203

    Article  Google Scholar 

  2. Younge AJ, Von Laszewski G, Wang L, Lopez-Alarcon S, Carithers W (2010) Efficient resource management for cloud computing environments. In: International conference on green computing. IEEE, pp 357–364

    Google Scholar 

  3. Bi J, Li S, Yuan H, Zhou M (2021) Integrated deep learning method for workload and resource prediction in cloud systems. Neurocomputing 424:35–48

    Article  Google Scholar 

  4. Haber MJ, Chappell B, Hills C (2022) Cloud computing. In: Cloud attack vectors. Springer, Berlin, pp 9–25

    Google Scholar 

  5. Khan Y, Varma S (2020) An efficient cloud forensic approach for IaaS, SaaS and PaaS model. In: 2nd international conference on data, engineering and applications (IDEA). IEEE, pp 1–6

    Google Scholar 

  6. Lorido-Botran T, Miguel-Alonso J, Lozano JA (2014) A review of auto-scaling techniques for elastic applications in cloud environments. J Grid Comput 12(4):559–592

    Article  Google Scholar 

  7. McGrath G, Brenner PR (2017) Serverless computing: design, implementation, and performance. In: IEEE 37th international conference on distributed computing systems workshops (ICDCSW). IEEE, pp 405–410

    Google Scholar 

  8. Pérez A, Moltó G, Caballer M, Calatrava A (2018) Serverless computing for container-based architectures. Futur Gener Comput Syst 83:50–59

    Article  Google Scholar 

  9. Mahmoudi N, Khazaei H (2020) Temporal performance modelling of serverless computing platforms. In: Proceedings of the sixth international workshop on serverless computing, pp 1–6

    Google Scholar 

  10. Suresh A, Gandhi A (2021) Server more: opportunistic execution of serverless functions in the cloud. In: Proceedings of the ACM symposium on cloud computing, pp 570–584

    Google Scholar 

  11. Shahrad M, Balkind J, Wentzlaff D (2019) Architectural implications of function-as-a-service computing. In: Proceedings of the 52nd annual IEEE/ACM international symposium on microarchitecture, pp 1063–1075

    Google Scholar 

  12. Sánchez-Artigas M, Sarroca PG (2021) Experience paper: towards enhancing cost efficiency in serverless machine learning training. In: Proceedings of the 22nd international middleware conference, pp 210–222

    Google Scholar 

  13. Raza A, Matta I, Akhtar N, Kalavri V, Isahagian V (2021) SoK: function-as-a-service: from an application developer’s perspective. J Syst Res 1(1)

    Google Scholar 

  14. Scheuner J, Leitner P (2020) Function-as-a-service performance evaluation: a multifocal literature review. J Syst Softw 170:110708

    Article  Google Scholar 

  15. Kaffes K, Yadwadkar NJ, Kozyrakis C (2019) Centralized core-granular scheduling for serverless functions. In: Proceedings of the ACM symposium on cloud computing, pp 158–164

    Google Scholar 

  16. Werner S, Girke R, Kuhlenkamp J (2020) An evaluation of serverless data processing frameworks. In: Proceedings of the sixth international workshop on serverless computing, pp 19–24

    Google Scholar 

  17. Hellerstein JM, Faleiro J, Gonzalez JE, Schleier-Smith J, Sreekanti V, Tumanov A, Wu C (2018) Serverless computing: one step forward, two steps back. arXiv preprint arXiv:1812.03651

  18. Choi S, Shahbaz M, Prabhakar B, Rosenblum M (2019) λ-nic: interactive serverless compute on smartnics. In: Proceedings of the ACM SIGCOMM conference posters and demos, pp 151–152

    Google Scholar 

  19. Carver B, Zhang J, Wang A, Anwar A, Wu P, Cheng Y (2020) Wukong: a scalable and locality-enhanced framework for serverless parallel computing. In: Proceedings of the 11th ACM symposium on cloud computing, pp 1–15

    Google Scholar 

  20. Pu Q, Venkataraman S, Stoica I (2019) Shuffling, fast and slow: scalable analytics on serverless infrastructure. In: 16th USENIX symposium on networked systems design and implementation (NSDI 19), pp 193–206

    Google Scholar 

  21. Castro P, Ishakian V, Muthusamy V, Slominski A (2019) The server is dead, long live the server: rise of serverless computing, overview of current state and future trends in research and industry. arXiv preprint arXiv:1906.02888

  22. Larrucea X, Santamaria I, Colomo-Palacios R, Ebert C (2018) Microservices. IEEE Softw 35(3):96–100

    Article  Google Scholar 

  23. Solaiman K, Adnan MA (2020) Wlec: a not so cold architecture to mitigate cold start problem in serverless computing. In: IEEE international conference on cloud engineering (IC2E). IEEE, pp 144–153

    Google Scholar 

  24. Al-Ali Z, Goodarzy S, Hunter E, Ha S, Han R, Keller E, Rozner E (2018) Making serverless computing more serverless. In: IEEE 11th international conference on cloud computing (CLOUD). IEEE, pp 456–459

    Google Scholar 

  25. Sewak M, Singh S (2018) Winning in the era of serverless computing and function as a service. In: 3rd international conference for convergence in technology (I2CT). IEEE, pp 1–5

    Google Scholar 

  26. Oakes E, Yang L, Zhou D, Houck K, Harter T, Arpaci-Dusseau A, Arpaci-Dusseau R (2018) {SOCK}: rapid task provisioning with {serverless-optimized} containers. In: 2018 USENIX annual technical conference (USENIX ATC 18), pp 57–70

    Google Scholar 

  27. Aytekin A, Johansson M (2019) Exploiting serverless runtimes for large-scale optimization. In: IEEE 12th international conference on cloud computing (CLOUD). IEEE, pp 499–501

    Google Scholar 

  28. Basu S, Kannayaram G, Ramasubbareddy S, Venkatasubbaiah C (2019) Improved genetic algorithm for monitoring of virtual machines in cloud environment. In: Smart intelligent computing and applications. Springer, Berlin, pp 319–326

    Google Scholar 

  29. Gouda K, Radhika T, Akshatha M (2013) Priority based resource allocation model for cloud computing. Int J Sci Eng Technol Res (IJSETR) 2(1):215–219

    Google Scholar 

  30. Singh S, Chana I, Singh M (2017) The journey of QoS-aware autonomic cloud computing. IT Professional 19(2):42–49

    Article  Google Scholar 

  31. Xu B, Zhao C, Hu E, Hu B (2011) Job scheduling algorithm based on Berger model in cloud environment. Adv Eng Softw 42(7):419–425

    Article  Google Scholar 

  32. Alqaryouti O, Siyam N (2018) Serverless computing and scheduling tasks on cloud: a review. Am Acad Sci Res J Eng Technol Sci 40(1):235–247

    Google Scholar 

  33. Niu X, Kumanov D, Hung L-H, Lloyd W, Yeung KY (2019) Leveraging serverless computing to improve performance for sequence comparison. In: Proceedings of the 10th ACM international conference on bioinformatics, computational biology and health informatics, pp 683–687

    Google Scholar 

  34. Zhao L, Yang Y, Li Y, Zhou X, Li K (2021) Understanding, predicting and scheduling serverless workloads under partial interference. In: Proceedings of the International conference for high performance computing, networking, storage and analysis, pp 1–15

    Google Scholar 

  35. Yuvaraj N, Karthikeyan T, Praghash K (2021) An improved task allocation scheme in serverless computing using gray wolf optimization (GWO) based reinforcement learning (RIL) approach. Wireless Pers Commun 117(3):2403–2421

    Article  Google Scholar 

  36. Mampage A, Karunasekera S, Buyya R (2021) Deadline-aware dynamic resource management in serverless computing environments. In: IEEE/ACM 21st international symposium on cluster, cloud and internet computing (CCGrid). IEEE, pp 483–492

    Google Scholar 

  37. Lloyd W, Vu M, Zhang B, David O, Leavesley G (2018) Improving application migration to serverless computing platforms: latency mitigation with keep-alive workloads. In: IEEE/ACM international conference on utility and cloud computing companion (UCC Companion). IEEE, pp 195–200

    Google Scholar 

  38. Gramaglia M, Serrano P, Banchs A, Garcia-Aviles G, Garcia-Saavedra A, Perez R (2020) The case for serverless mobile networking. In: IFIP networking conference (Networking). IEEE, pp 779–784

    Google Scholar 

  39. Pawlik M, Banach P, Malawski M (2019) Adaptation of workflow application scheduling algorithm to serverless infrastructure. In: European conference on parallel processing. Springer, Berlin, pp 345–356

    Google Scholar 

  40. García-López P, Sánchez-Artigas M, Shillaker S, Pietzuch P, Breitgand D, Vernik G, Sutra P, Tarrant T, Ferrer AJ (2019) Servermix: tradeoffs and challenges of serverless data analytics. arXiv preprint arXiv:1907.11465

  41. Singhvi A, Houck K, Balasubramanian A, Shaikh MD, Venkataraman S, Akella A (2019) Archipelago: a scalable low-latency serverless platform. arXiv preprint arXiv:1911.09849

  42. Yao C, Liu W, Tang W, Hu S (2022) EAIS: energy-aware adaptive scheduling for CNN inference on high-performance GPUs. Futur Gener Comput Syst 130:253–268

    Article  Google Scholar 

  43. Kallam S, Patan R, Ramana TV, Gandomi AH (2021) Linear weighted regression and energy-aware greedy scheduling for heterogeneous big data. Electronics 10(5):554

    Article  Google Scholar 

  44. Aslanpour MS, Toosi AN, Cheema MA, Gaire R (2022) Energy-aware resource scheduling for serverless edge computing. In: 22nd IEEE international symposium on cluster, cloud and internet computing (CCGrid). IEEE, pp 190–199

    Google Scholar 

  45. Gunasekaran JR, Thinakaran P, Kandemir MT, Urgaonkar B, Kesidis G, Das C (2019) Spock: exploiting serverless functions for slo and cost aware resource procurement in public cloud. In: IEEE 12th international conference on cloud computing (CLOUD). IEEE, pp 199–208

    Google Scholar 

  46. Rausch T, Rashed A, Dustdar S (2021) Optimized container scheduling for data-intensive serverless edge computing. Futur Gener Comput Syst 114:259–271

    Article  Google Scholar 

  47. HoseinyFarahabady MR, Taheri J, Zomaya AY, Tari Z (2021) Data-intensive workload consolidation in serverless (Lambda/FaaS) platforms. In: IEEE 20th international symposium on network computing and applications (NCA). IEEE, pp 1–8

    Google Scholar 

  48. Wu J, Wu M, Li H, Li L, Li L (2022) A serverless-based, on-the-fly computing framework for remote sensing image collection. Remote Sens 14(7):1728

    Article  Google Scholar 

  49. Krishna SR, Majji S, Kishore SK, Jaiswal S, Kostka JAL, Chouhan AS (2021) Optimization of time-driven scheduling technique for serverless cloud computing. Turkish J Comput Math Educ 12(10):1–8

    Google Scholar 

  50. Wang B, Ali-Eldin A, Shenoy P (2021) Lass: running latency sensitive serverless computations at the edge. In: Proceedings of the 30th international symposium on high-performance parallel and distributed computing, pp 239–251

    Google Scholar 

  51. Cheng Y, Zhou Z (2018) Autonomous resource scheduling for real-time and stream processing. In: IEEE smart world, ubiquitous intelligence and computing, advanced and trusted computing, scalable computing and communications, cloud and big data computing, internet of people and smart city innovation (Smart World/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, pp 1181–1184

    Google Scholar 

  52. Suresh A, Gandhi A (2019) Fnsched: an efficient scheduler for serverless functions. In: Proceedings of the 5th international workshop on serverless computing, pp 19–24

    Google Scholar 

  53. Kim YK, HoseinyFarahabady MR, Lee YC, Zomaya AY (2020) Automated fine-grained cup cap control in serverless computing platform. IEEE Trans Parallel Distrib Syst 31(10):2289–2301

    Article  Google Scholar 

  54. De Palma G, Giallorenzo S, Mauro J, Trentin M, Zavattaro G (2022) A declarative approach to topology-aware serverless function-execution scheduling. In: 2022 IEEE international conference on web services (ICWS). IEEE, pp 337–342

    Google Scholar 

  55. Bai T, Nie J-Y, Zhao WX, Zhu Y, Du P, Wen J-R (2018) An attribute-aware neural attentive model for next basket recommendation. In: The 41st international ACM SIGIR conference on research and development in information retrieval, pp 1201–1204

    Google Scholar 

  56. Bisht J, Vampugani VS (2022) Load and cost-aware min-min workflow scheduling algorithm for heterogeneous resources in fog, cloud, and edge scenarios. Int J Cloud Appl Comput (IJCAC) 12(1):1–20

    Google Scholar 

  57. Shafiei H, Khonsari A, Mousavi P (2022) Serverless computing: a survey of opportunities, challenges, and applications. ACM Comput Surv 54(11s):1–32. Article No: 239. https://doi.org/10.1145/3510611

  58. Silab MV, Hassanpour SB, Khonsari A, Dadlani A (2022) On skipping redundant computation via smart task deployment for faster serverless. In: ICC-IEEE international conference on communications. IEEE, pp 5475–5480

    Google Scholar 

  59. Banaei A, Sharifi M (2022) ETAS: predictive scheduling of functions on worker nodes of Apache OpenWhisk platform. J Supercomput 78(4):5358–5393

    Article  Google Scholar 

  60. Van Eyk E, Iosup A, Seif S, Thömmes M (2017) The SPEC cloud group’s research vision on FaaS and serverless architectures. In: Proceedings of the 2nd international workshop on serverless computing, pp 1–4

    Google Scholar 

  61. Kijak J, Martyna P, Pawlik M, Balis B, Malawski M (2018) Challenges for scheduling scientific workflows on cloud functions. In: IEEE 11th international conference on cloud computing (CLOUD). IEEE, pp 460–467

    Google Scholar 

  62. Li Y, Lin Y, Wang Y, Ye K, Xu C-Z (2022) Serverless computing: state-of-the-art, challenges and opportunities. IEEE Trans Serv Comput. https://doi.org/10.1109/TSC.2022.3166553

  63. Gadepalli PK, Peach G, Cherkasova L, Aitken R, Parmer G (2019) Challenges and opportunities for efficient serverless computing at the edge. In: 38th symposium on reliable distributed systems (SRDS). IEEE, pp 261–2615

    Google Scholar 

  64. Aslanpour MS, Toosi AN, Cicconetti C, Javadi B, Sbarski P, Taibi D, Assuncao M, Gill SS, Gaire R, Dustdar S (2021) Serverless edge computing: vision and challenges. In: Australasian computer science week multiconference, pp 1–10

    Google Scholar 

  65. Kritikos K, Skrzypek P (2018) A review of serverless frameworks. In: IEEE/ACM international conference on utility and cloud computing companion (UCC Companion). IEEE, pp 161–168

    Google Scholar 

  66. Wang H, Liu T, Kim B, Lin C-W, Shiraishi S, Xie J, Han Z (2020) Architectural design alternatives based on cloud/edge/fog computing for connected vehicles. IEEE Commun Surv Tutorials 22(4):2349–2377

    Article  Google Scholar 

  67. Martins HJM (2019) Plataformas de computação serverless: Estudo e benckmark. Universidade de Coimbra

    Google Scholar 

  68. Das S (2021) Ant colony optimization for mapreduce application to optimize task scheduling in serverless platform. National College of Ireland, Dublin

    Google Scholar 

  69. Zuk P, Rzadca K (2022) Reducing response latency of composite functions-as-a-service through scheduling. J Parallel Distrib Comput 167:18–30

    Article  Google Scholar 

  70. Lakhan A, Mohammed MA, Rashid AN, Kadry S, Panityakul T, Abdulkareem KH, Thinnukool O (2021) Smart-contract aware ethereum and client-fog-cloud healthcare system. Sensors 21(12):4093

    Article  Google Scholar 

  71. Totoy G, Boza EF, Abad CL (2018) An extensible scheduler for the OpenLambda FaaS platform. In: Min-Move’18

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Qom Branch, Islamic Azad University, Qom, Iran

    Mostafa Ghobaei-Arani & Mohsen Ghorbian

Authors
  1. Mostafa Ghobaei-Arani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohsen Ghorbian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mostafa Ghobaei-Arani .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, Jaypee Institute of Information Technology, Noida, India

    Rajalakshmi Krishnamurthi

  2. School of Computer Science, University of Petroleum and Energy Studies, Dehradun, Uttarakhand, India

    Adarsh Kumar

  3. School of Electronic Engineering and Computer Science, Queen Mary University of London, London, UK

    Sukhpal Singh Gill

  4. School of Computing and Information Systems, The University of Melbourne, Melbourne, VIC, Australia

    Rajkumar Buyya

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ghobaei-Arani, M., Ghorbian, M. (2023). Scheduling Mechanisms in Serverless Computing. In: Krishnamurthi, R., Kumar, A., Gill, S.S., Buyya, R. (eds) Serverless Computing: Principles and Paradigms. Lecture Notes on Data Engineering and Communications Technologies, vol 162. Springer, Cham. https://doi.org/10.1007/978-3-031-26633-1_10

Download citation

Publish with us

Policies and ethics

Search

Navigation