Hybrid scheduling for scientific workflows on hybrid clouds

2019 2019 Sharif, 2017, Privacy-aware scheduling SaaS in high performance computing environments, IEEE Trans. Parallel Distrib. Syst., 28, 1176, 10.1109/TPDS.2016.2603153 2019 Heath, 2014, Bionimbus: a cloud for managing, analyzing and sharing large genomics datasets, J. Am. Med. Inform. Assoc., 21, 969, 10.1136/amiajnl-2013-002155 Van den Bossche, 2013, Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds, Future Gener. Comput. Syst., 29, 973, 10.1016/j.future.2012.12.012 Malawski, 2013, Cost minimization for computational applications on hybrid cloud infrastructures, Future Gener. Comput. Syst., 29, 1786, 10.1016/j.future.2013.01.004 Lin, 2016, Online optimization scheduling for scientific workflows with deadline constraint on hybrid clouds, Concurr. Comput.: Pract. Exper., 28, 3079, 10.1002/cpe.3582 Lin, 2016, A pretreatment workflow scheduling approach for big data applications in multicloud environments, IEEE Trans. Netw. Serv. Manag., 13, 581, 10.1109/TNSM.2016.2554143 Rahman, 2011, Hybrid heuristic for scheduling data analytics workflow applications in hybrid cloud environment, 966 Bittencourt, 2011, HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds, J. Internet Serv. Appl., 2, 207, 10.1007/s13174-011-0032-0 Abrishami, 2012, Cost-driven scheduling of grid workflows using partial critical paths, IEEE Trans. Parallel Distrib. Syst., 23, 1400, 10.1109/TPDS.2011.303 Abrishami, 2013, Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds, Future Gener. Comput. Syst., 29, 158, 10.1016/j.future.2012.05.004 Byun, 2011, BTS: Resource capacity estimate for time-targeted science workflows, J. Parallel Distrib. Comput., 71, 848, 10.1016/j.jpdc.2011.01.008 F.J. Clemente-Castelló, R. Mayo, J.C. Fernández, Cost model and analysis of iterative mapreduce applications for hybrid cloud bursting, in: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID, 2017, pp. 858–864. F.J. Clemente-Castello, B. Nicolae, M.M. Rafique, R. Mayo, J.C. Fernandez, Evaluation of data locality strategies for hybrid cloud bursting of iterative mapreduce, in: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2017, pp. 181–185. H. Chu, Y. Simmhan, Cost-efficient and resilient job life-cycle management on hybrid clouds, in: IEEE 28th International Parallel and Distributed Processing Symposium, 2014, pp. 327–336. M.R. Hoseinyfarahabady, H.R.D. Samani, L.M. Leslie, Y.C. Lee, A.Y. Zomaya, Handling uncertainty: Pareto-efficient BoT scheduling on hybrid clouds, in: 2013 42nd International Conference on Parallel Processing, 2013, pp. 419–428. Yuan, 2016, TTSA: An effective scheduling approach for delay bounded tasks in hybrid clouds, IEEE Trans. Cybern., 47, 3658, 10.1109/TCYB.2016.2574766 A. Pasdar, K. Almi’ani, Y.C. Lee, Data-aware scheduling of scientific workflows in hybrid clouds, in: International Conference on Computational Science, ICCS, 2018, pp. 708–714. Richard, 2011, Effective heuristics for NP-hard problems Jacob, 2009, Montage; a grid portal and software toolkit for science grade astronomical image mosaicking, Int. J. Comput. Sci. Eng., 4, 73 Abramovici, 1992, LIGO: The laser interferometer gravitational-wave observatory, Science, 256, 325, 10.1126/science.256.5055.325 2019 Topcuoglu, 2002, Performance-effective and low-complexity task scheduling for heterogeneous computing, IEEE Trans. Parallel Distrib. Syst., 13, 260, 10.1109/71.993206 Wang, 2013, Adaptive scheduling for parallel tasks with qos satisfaction for hybrid cloud environments, J. Supercomput., 66, 783, 10.1007/s11227-013-0890-2 Delavar, 2014, HSGA: a hybrid heuristic algorithm for workflow scheduling in cloud systems, Cluster Comput., 17, 129, 10.1007/s10586-013-0275-6 Huang, 2019, Task scheduling in cloud computing using particle swarm optimization with time varying inertia weight strategies, Cluster Comput., 1 Yuan, 2010, A data placement strategy in scientific cloud workflows, Future Gener. Comput. Syst., 26, 1200, 10.1016/j.future.2010.02.004 K. Deng, J. Song, K. Ren, D. Yuan, J. Chen, Graph-cut based coscheduling strategy towards efficient execution of scientific workflows in collaborative cloud environments, in: 2011 IEEE/ACM 12th International Conference on Grid Computing, 2011, pp. 34–41. Malawski, 2015, Algorithms for cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds, Future Gener. Comput. Syst., 48, 1, 10.1016/j.future.2015.01.004 Deldari, 2017, CCA: a deadline-constrained workflow scheduling algorithm for multicore resources on the cloud, J. Supercomput., 73, 756, 10.1007/s11227-016-1789-5 Deng, 2011, A weighted k-means clustering based co-scheduling strategy towards efficient execution of scientific workflows in collaborative cloud environments, 547 F. Ma, Y. Yang, T. Li, A data placement method based on Bayesian network for data-intensive scientific workflows, in: 2012 International Conference on Computer Science and Service System, 2012, pp. 1811–1814. Teylo, 2017, A hybrid evolutionary algorithm for task scheduling and data assignment of data-intensive scientific workflows on clouds, Future Gener. Comput. Syst., 76, 1, 10.1016/j.future.2017.05.017 Djebbar, 2013, Optimization of tasks scheduling by an efficacy data placement and replication in cloud computing, 22 Yuan, 2011, On-demand minimum cost benchmarking for intermediate dataset storage in scientific cloud workflow systems, J. Parallel Distrib. Comput., 71, 316, 10.1016/j.jpdc.2010.09.003 Z. Liu, T. Xiang, B. Lin, X. Ye, H. Wang, Y. Zhang, X. Chen, A data placement strategy for scientific workflow in hybrid cloud, in: 2018 IEEE 11th International Conference on Cloud Computing, CLOUD, 2018, pp. 556–563. Yuan, 2019, Multiqueue scheduling of heterogeneous tasks with bounded response time in hybrid green IaaS clouds, IEEE Trans. Ind. Inf., 15, 5404, 10.1109/TII.2019.2901518 Clemente-Castelló, 2018, Performance model of mapreduce iterative applications for hybrid cloud bursting, IEEE Trans. Parallel Distrib. Syst., 29, 1794, 10.1109/TPDS.2018.2802932 Mechtri, 2015, Exact and heuristic resource mapping algorithms for distributed and hybrid clouds, IEEE Trans. Cloud Comput., 5, 681, 10.1109/TCC.2015.2427192 Rezaeian, 2016, A budget constrained scheduling algorithm for hybrid cloud computing systems under data privacy, 230 Malawski, 2014, Cost optimization of execution of multi-level deadline-constrained scientific workflows on clouds, 251 X. Liu, A. Datta, Towards intelligent data placement for scientific workflows in collaborative cloud environment, in: 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum, 2011, pp. 1052–1061. Farahabady, 2014, Pareto-Optimal cloud bursting, IEEE Trans. Parallel Distrib. Syst., 25, 2670, 10.1109/TPDS.2013.218 H.Y. Chu, Y. Simmhan, Cost-efficient and resilient job life-cycle management on hybrid clouds, in: 2014 IEEE 28th International Parallel and Distributed Processing Symposium, 2014, pp. 327–336. Wu, 2016, Hybridscaler: Handling bursting workload for multi-tier web applications in cloud, 141 Cunha, 2017, Job placement advisor based on turnaround predictions for HPC hybrid clouds, Future Gener. Comput. Syst., 67, 35, 10.1016/j.future.2016.08.010 Marcu, 2015, Dynamic scheduling in real time with budget constraints in hybrid clouds, 18 Zinnen, 2011, Deadline constrained scheduling in hybrid clouds with Gaussian processes, 294 Wang, 2016, Managing deadline-constrained bag-of-tasks jobs on hybrid clouds, 1 Yuan, 2017, Temporal task scheduling with constrained service delay for profit maximization in hybrid clouds, IEEE Trans. Autom. Sci. Eng., 14, 337, 10.1109/TASE.2016.2526781 M.R. Hoseinyfarahabady, H.R.D. Samani, L.M. Leslie, Y.C. Lee, A.Y. Zomaya, Handling uncertainty: Pareto-efficient BoT scheduling on hybrid clouds, in: 2013 42nd International Conference on Parallel Processing, 2013, pp. 419–428. Lee, 2017, Cloud bursting scheduler for cost efficiency, 774 Bittencourt, 2010, Scheduling service workflows for cost optimization in hybrid clouds, 394 Al-Hassan, 2006, Psosa: An optimized particle swarm technique for solving the urban planning problem, 401 Juve, 2013, Characterizing and profiling scientific workflows, Future Gener. Comput. Syst., 29, 682, 10.1016/j.future.2012.08.015 Calheiros, 2011, Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms, Softw. Pract. Exper., 41, 23, 10.1002/spe.995 2019 2019 2019 Varia, 2012, 1