Abstract
To improve the efficiency and productivity of modern manufacturing, the requirements for enterprises are discussed. The new emerged technologies such as cloud computing and internet of things are analyzed and the bottlenecks faced by enterprises in manufacturing big data analytics are investigated. Scientific workflow technology as a method to solve the problems is introduced and an architecture of scientific workflow management system based on cloud manufacturing service platform is proposed. The functions of each layer in the architecture are described in detail and implemented with an existing workflow system as a case study. The workflow scheduling algorithm is the key issue of management system, and the related work is reviewed. This paper takes the general problems of existing algorithms as the motivation to propose a novel scheduling algorithm called MP (max percentages) algorithm. The simulation results indicate that the proposed algorithm has performed better than the other five classic algorithms with respect to both the total completion time and load balancing level.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Chui M, Loffler M, Robert R (2010) The internet of things. Mckinsey Q 2:1–9
Barolli L, Chen X, Xhafa F (2014) Advances on cloud services and cloud computing. Concurr Comput-Pract Exp 27(8):1985–1987
Liu J, Pacitti E, Valduriez P, Mattoso M (2015) A survey of DataIntensive scientific workflow management. J Grid Comput 3:1–37
Holl S, Zimmermann O, Palmblad M, Mohammed Y, Hofmann-Apitius M (2014) A new optimization phase for scientific workflow management systems. Futur Gener Comp Syst 36:352–362
Gan Z, Wang J, Salomonis N, Stowe JC, Haddad GG, McCulloch AD, Zambon AC (2014) MAAMD: a workflow to standardize meta-analyses and comparison of affymetrix microarray data. BMC Bioinformatics 15(1):69
Zhao Y, Li Y, Lu S, Lin C (2014) Devising a cloud scientific workflow platform for big data. IEEE World Congress on Services IEEE: 393-401
Huang B, Li C, Yin C, Zhao X (2013) Cloud manufacturing service platform for small-and medium-sized enterprises. Int J Adv Manuf Technol 65(9-12):1261–1272
Lin C, Lu S, Fei X, Chebotko A, Pai D, Lai Z, Hua J (2009) A reference architecture for scientific workflow management systems and the VIEW SOA solution. IEEE Trans Serv Comput 2(1):79–92
Malawski M, Juve G, Deelman E, Nabrzyski J (2015) Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds. Futur Gener Comp Syst 48:1–18
Fard HM, Radu P, Thomas F (2014) Multi-objective list scheduling of workflow applications in distributed computing infrastructures. J Parallel Distr Com 74(3):2152–2165
Hongzhao D, Dongxu L, Yanwei Z, Ying C (2005) A novel approach of networked manufacturing collaboration: fractal web-based extended enterprise. Int J Adv Manuf Technol 26(11-12):1436–1442
Flammia G (2001) Application service providers: challenges and opportunities. IEEE Intell Syst 16(1):22–23
Xu X (2012) From cloud computing to cloud manufacturing. Robot Cim-Int Manuf 28(1):75–86
Tao F, Cheng Y, Da Xu L, Zhang L, Li BH (2014) CCIoT-CMfg: cloud computing and Internet of things-based cloud manufacturing service system. IEEE T Ind Inform 10(2):1435–1442
Laili Y, Tao F, Zhang L, Sarker BR (2012) A study of optimal allocation of computing resources in cloud manufacturing systems. Int J Adv Manuf Technol 63(5-8):671–690
Lee J, Lapira E, Bagheri B, Kao HA (2013) Recent advances and trends in predictive manufacturing systems in big data environment. Manuf Lett 1(1):38–41
Barseghian D, Altintas I, Jones MB et al (2010) Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis. Ecol Inf 5(1):42–50
Li X, Song J, Huang R (2014) A Kepler scientific workflow to facilitate and standardize marine monitoring sensor parsing and dynamic adaption. 5th IEEE Int Conf Softw Engine Serv Sci IEEE: 1023-1026
Paterson T, Law A (2009) An XML transfer schema for exchange of genomic and genetic mapping data: implementation as a web service in a Taverna workflow. BMC Bioinformatics 10(1):252
Deelman E, Singh G, Su MH, Blythe J, Gil Y, Kesselman C, Katz DS (2005) Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci Programming-Neth 13(3):219–237
Fahringer T, Prodan R, Duan R, Hofer J, Nadeem F, Nerieri F, Wieczorek M (2007) Askalon: A development and grid computing environment for scientific workflows. Workflows for e-Science. Springer, London, pp 450–471
Von Laszewski G, Gawor J, Lane P, Rehn N, Russell M (2002) Features of the java commodity grid kit. Concurr Comput-Pract Exp 14(13-15):1045–1055
Kacsuk P, Sipos G (2005) Multi-grid, multi-user workflows in the P-GRADE grid portal. J Grid Comput 3(3-4):221–238
Guan Z, Hernandez F, Bangalore P, Gray J, Skjellum A, Velusamy V, Liu Y (2006) Grid-flow: a grid-enabled scientific workflow system with a petri-net-based interface. Concurr Comput-Pract Exp 18(10):1115–1140
Bubak M, Nowakowski P, Unger S (2006) K-WfGrid—knowledge-based workflow system for grid applications. Proc CGW 6:1–12
MTConnect Institute (2013) MTConnect Institute. http://www.mtconnect.org/. Accessed on May 27 2015
Wang J, Crawl D, Altintas I, Li W (2014) Big data applications using workflows for data parallel computing. Comput Sci Eng 16(4):11–21
Wang J, Crawl D, Altintas I (2009) Kepler + Hadoop: a general architecture facilitating data-intensive applications in scientific workflow systems. Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science ACM : 12
Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. Proceedings of the 2nd USENIX conference on Hot topics in cloud computing: 10-10
Djurdjanovic D, Lee J, Ni J (2003) Watchdog Agent—an infotronics-based prognostics approach for product performance degradation assessment and prediction. Adv Eng Inform 17(3):109–125
Wang L (2013) Directed acyclic graph. Encyclopedia of Systems Biology: 574-574
Yu-Kwong K, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans on Par and Dist Systems 5(7):506–521
Rodriguez Sossa M, Buyya R (2014) Deadline based resource provisioning and scheduling algorithmfor scientific workflows on clouds, cloud computing. IEEE Trans 2(2):222–235
Chunlin L, Layuan L (2006) QoS based resource scheduling by computational economy in computational grid. Inf Process Lett 98(3):119–126
Singh S, Chana I (2015) QRSF: QoS-aware resource scheduling framework in cloud computing. J Supercomput 71(1):241–292
Ezzatti P, Pedemonte M, Martin A (2013) An efficient implementation of the Min-Min heuristic. Comput Oper Res 40(11):2670–2676
He XS, Sun XH, Von Laszewski G (2003) QoS guided min-min heuristic for grid task scheduling. J Comput Sci Technol 18(4):442–451
Singh M, Suri PK (2008) QPS Max-Min Min-Min: a QoS based predictive Max-Min, Min-Min switcher algorithm for Job scheduling in a grid. Inform Technol J 8:1176–1181
Kartal Tabak E, Barla Cambazoglu B, Aykanat C (2014) Improving the performance of independent task assignment heuristics minmin, maxmin and sufferage. IEEE Trans Parallel Distrib Syst 25(5):1244–1256
Casanova H, Legrand A, Zagorodnov D, Berman, F (2000) Heuristics for scheduling parameter sweep applications in grid environments. Proceedings 9th Heterogeneous Computing Workshop. IEEE: 349-363
Yu J, Buyya R (2006) Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci Programming-Neth 14(3-4):217–230
Wieczorek M, Prodan R, Fahringer T (2005) Scheduling of scientific workflows in the ASKALON grid environment. ACM Sigmod Rec 34(3):56–62
Guo F, Yu L, Tian S, Tian S (2014) A workflow task scheduling algorithm based on the resources' fuzzy clustering in cloud computing environment. Int J Commun Syst 28(6):1053–1067
Bittencourt LF, Madeira ERM (2013) Using time discretization to schedule scientific workflows in multiple cloud providers. Sixth IEEE Int Conf Cloud Comput IEEE: 123-130
Chauhan SS, Joshi RC (2010) A weighted mean time min-min max-min selective scheduling strategy for independent tasks on grid. 2rd IEEE Int Adv Comput Conf IEEE:4-9
Ahmad I, Kwok YK, Wu MY (1996) Analysis, evaluation, and comparison of algorithms for scheduling task graphs on parallel processors. Proceedings of Second International Symposium on Parallel Architectures, Algorithms, and Networks IEEE: 207-213
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, X., Song, J. & Huang, B. A scientific workflow management system architecture and its scheduling based on cloud service platform for manufacturing big data analytics. Int J Adv Manuf Technol 84, 119–131 (2016). https://doi.org/10.1007/s00170-015-7804-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-015-7804-9