Asymptotic scheduling for many task computing in Big Data platforms

Information Sciences - Tập 319 - Trang 71-91 - 2015
Andrei Sfrent1, Florin Pop1
1Faculty of Automatic Control and Computers, University Politehnica of Bucharest, Romania

Tài liệu tham khảo

Assuncao, 2014, Big data computing and clouds: trends and future directions, J. Parall. Distrib. Comput., 2014 Baykasoğlu, 2014, Testing the performance of teaching–learning based optimization (TLBO) algorithm on combinatorial problems: flow shop and job shop scheduling cases, Inform. Sci., 276, 204, 10.1016/j.ins.2014.02.056 Brucker, 2007 Brucker, 2012, A branch and bound algorithm for the cyclic job-shop problem with transportation, Comput. Oper. Res., 39, 3200, 10.1016/j.cor.2012.04.008 Brumfiel, 2011, High-energy physics: down the petabyte highway, Nature, 2011, 282 Capannini, 2007, A job scheduling framework for large computing farms, 54:1 Celaya, 2013, A task routing approach to large-scale scheduling, Future Gener. Comput. Syst., 29, 1097, 10.1016/j.future.2012.12.009 Chang, 2012, An adaptive scoring job scheduling algorithm for grid computing, Inform. Sci., 207, 79, 10.1016/j.ins.2012.04.019 Costa, 2009, Applying reinforcement learning to scheduling strategies in an actual grid environment, Int. J. High Perform. Syst. Archit., 2, 116, 10.1504/IJHPSA.2009.032029 Garey, 1976, The complexity of flowshop and jobshop scheduling, Math. Oper. Res., 1, 117, 10.1287/moor.1.2.117 Gorgan, 2010, Experiments on ESIP – environment oriented satellite data processing platform, Earth Sci. Inform., 3, 297, 10.1007/s12145-010-0065-0 Henzinger, 2011, Scheduling large jobs by abstraction refinement, 329 J. Hu, Realistic Models for Scheduling Tasks on Network Nodes, Ph.D. Thesis, California State University at Long Beach, Long Beach, CA, USA, aAI3302285, 2008. Huang, 2007, Using NARX neural network based load prediction to improve scheduling decision in grid environments, 05, 718 Huang, 2014, Design of hybrid radial basis function neural networks (HRBFNNs) realized with the aid of hybridization of fuzzy clustering method (FCM) and polynomial neural networks (PNNs), Neural Netw., 60, 166, 10.1016/j.neunet.2014.08.007 Istin, 2011, Higa: hybrid immune – genetic algorithm for dependent task scheduling in large scale distributed systems, 282 J. Kolodziej, M. Szmajduch, T. Maqsood, S. Madani, N. Min-Allah, S. Khan, Energy-aware grid scheduling of independent tasks and highly distributed data, in: Proceedings – 11th International Conference on Frontiers of Information Technology, FIT 2013, 2013, pp. 211–216. Koulinas, 2014, A particle swarm optimization based hyper-heuristic algorithm for the classic resource constrained project scheduling problem, Inform. Sci., 277, 680, 10.1016/j.ins.2014.02.155 Liu, 2015, Fuzzy clustering with semantic interpretation, Appl. Soft Comput., 26, 21, 10.1016/j.asoc.2014.09.037 Y. Mhedheb, F. Jrad, J. Tao, J. Zhao, J. Kołodziej, A. Streit, Load and thermal-aware vm scheduling on the cloud, in: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8285 LNCS (PART 1), 2013, pp. 101–114. Olteanu, 2012, A dynamic rescheduling algorithm for resource management in large scale dependable distributed systems, Comput. Math. Appl., 63, 1409, 10.1016/j.camwa.2012.02.066 Pan, 2014, An improved migrating birds optimisation for a hybrid flowshop scheduling with total flowtime minimisation, Inform. Sci., 277, 643, 10.1016/j.ins.2014.02.152 Pinel, 2013, Solving very large instances of the scheduling of independent tasks problem on the GPU, J. Parall. Distrib. Comput., 73, 101, 10.1016/j.jpdc.2012.02.018 Pop, 2010, Dynamic meta-scheduling architecture based on monitoring in distributed systems, Int. J. Auton. Comput., 1, 328, 10.1504/IJAC.2010.037511 I. Rao, E. Huh, S. Lim, An adaptive and efficient design and implementation for meteorology data grid using grid technology, in: Proceedings of the 15th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WETICE ’06, IEEE Computer Society, Washington, DC, USA, 2006, pp. 239–246. http://dx.doi.org/10.1109/WETICE.2006.19. Rodger, 2014, A fuzzy nearest neighbor neural network statistical model for predicting demand for natural gas and energy cost savings in public buildings, Expert Syst. Appl., 41, 1813, 10.1016/j.eswa.2013.08.080 Rodger, 2012, Toward reducing failure risk in an integrated vehicle health maintenance system: a fuzzy multi-sensor data fusion kalman filter approach for {IVHMS}, Expert Syst. Appl., 39, 9821, 10.1016/j.eswa.2012.02.171 Serafini, 2003, Asymptotic scheduling, Math. Program., 98, 431, 10.1007/s10107-003-0412-8 Serbanescu, 1998, Noncommutative Markov processes as stochastic equations’ solutions, Bull. Math. Soc. Sci. Math. Roum. Tome 41, 89, 219 Serbanescu, 1998, Stochastic differential equations and unitary processes, Bull. Math. Soc. Sci. Math. Roum. Tome 41, 89, 311 Sinnen, 2006, Toward a realistic task scheduling model, IEEE Trans. Parall. Distrib. Syst., 17, 263, 10.1109/TPDS.2006.40 Tang, 2014, A self-adaptive scheduling algorithm for reduce start time, Future Gener. Comput. Syst., 2014 Tang, 2010, A hybrid PSO/GA algorithm for job shop scheduling problem, vol. Part I, 566 M.-A Vasile, F. Pop, R.-I. Tutueanu, V. Cristea, J. Kołodziej, Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing, Future Gener. Comput. Syst. 9 December 2014 (in press). http://dx.doi.org/10.1016/j.future.2014.11.019. <http://www.sciencedirect.com/science/article/pii/S0167739X14002532>. Xu, 2014, A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues, Inform. Sci., 270, 255, 10.1016/j.ins.2014.02.122 L. Xu, Q.-m. Zhu, Z. Gong, P.-f. Li, Adjsa: an adaptable dynamic job scheduling approach based on historical information, in: Proceedings of the 2nd International Conference on Scalable Information Systems, InfoScale ’07, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 2007, pp. 31:1–31:2. <http://dl.acm.org/citation.cfm?id=1366804.1366844>. Yan, 2014, Hypergraph-based data link layer scheduling for reliable packet delivery in wireless sensing and control networks with end-to-end delay constraints, Inform. Sci., 278, 34, 10.1016/j.ins.2014.02.006 Yeh, 2014, Parallel-machine scheduling to minimize makespan with fuzzy processing times and learning effects, Inform. Sci., 269, 142, 10.1016/j.ins.2013.10.023 Zhang, 2014, Multi-objective scheduling of many tasks in cloud platforms, Future Gener. Comput. Syst., 37, 309, 10.1016/j.future.2013.09.006 Zhang, 2010, A hybrid approach to large-scale job shop scheduling, Appl. Intell., 32, 47, 10.1007/s10489-008-0134-y Zhang, 2012, Task scheduling for GPU heterogeneous cluster, 161 Zhou, 1991, A neural network approach to job-shop scheduling, Trans. Neural Netw., 2, 175, 10.1109/72.80311 Ziaee, 2013, General flowshop scheduling problem with the sequence dependent setup times: a heuristic approach, Inform. Sci., 251, 126, 10.1016/j.ins.2013.06.025