An SCP-based heuristic approach for scheduling distributed data-intensive applications on global grids

Journal of Parallel and Distributed Computing - Tập 68 - Trang 471-487 - 2008
Srikumar Venugopal1, Rajkumar Buyya1
1Grid Computing and Distributed Systems (GRIDS) Laboratory, Department of Computer Science and Software Engineering, The University of Melbourne, VIC 3010, Australia

Tài liệu tham khảo

Acharya, 1996, Tuning the performance of I/O-intensive parallel applications Balas, 1972, On the set-covering problem, Oper. Res., 20, 1152, 10.1287/opre.20.6.1152 Bell, 2002, Simulation of dynamic grid replication strategies in OptorSim, 46 Blythe, 2005, Task scheduling strategies for workflow-based applications in grids Braun, 2001, A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems, J. Parallel Distributed Comput., 61, 810, 10.1006/jpdc.2000.1714 Breslau, 1999, Web catching and zipf-like distributions R. Buyya, Economic-based distributed resource management and scheduling for grid computing, Ph.D. Thesis, Monash University, Australia (2002). Buyya, 2002, GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing, Concurrency Comput. Practice and Experience (CCPE), 14, 1175, 10.1002/cpe.710 Cameron, 2003, Evaluating scheduling and replica optimisation strategies in OptorSim H. Casanova, Simgrid: a toolkit for the simulation of application scheduling, in: Proceedings of the First International Symposium on Cluster Computing and the Grid (CCGRID ’01), IEEE CS Press, Los Alamitos, CA, USA, Brisbane, Australia, 2001. Casanova, 2000, Heuristics for scheduling parameter sweep applications in grid environments Chervenak, 2000, The data grid: towards an architecture for the distributed management and analysis of large scientific datasets, J. Network Comput. Appl., 23, 187, 10.1006/jnca.2000.0110 N. Christofides, Graph Theory: An Algorithmic Approach, Academic Publishers, London, UK, 1975, Ch. Independent and Dominating Sets—The Set Covering Problem, pp. 30 – 57, ISBN 012 1743350 0. Cormen, 2001 Deelman, 2003, Mapping abstract complex workflows onto grid environments, J. Grid Comput., 1, 25, 10.1023/A:1024000426962 Foster, 1999 R. Gardner, et al., The Grid2003 production grid: principles and practice, in: Proceedings of the 13th Symposium on High Performance Distributed Computing (HPDC 13), IEEE CS Press, Los Alamitos, CA, USA, Honolulu, HI, USA, 2004. Giersch, 2004, Scheduling tasks sharing files from distributed repositories Hoschek, 2000, Data management in an international data grid project Jain, 1997, Heuristics for scheduling I/O operations, IEEE Trans. Parallel Distributed Systems, 8, 310, 10.1109/71.584096 Kafil, 1998, Optimal task assignment in heterogeneous distributed computing systems, IEEE Concurrency, 6, 42, 10.1109/4434.708255 Khan, 2006, Non-cooperative, semi-cooperative, and cooperative games-based grid resource allocation Khanna, 2005, A hypergraph partitioning-based approach for scheduling of tasks with batch-shared I/O Kwok, 1996, Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors, IEEE Trans. Parallel Distrib. System, 7, 506, 10.1109/71.503776 Kwok, 1999, Static scheduling algorithms for allocating directed task graphs to multiprocessors, ACM Comput. Surveys, 31, 406, 10.1145/344588.344618 Kwok, 2005, Selfish grid computing, 1143 Legrand, 2000, The MONARC toolset for simulating large network-distributed processing systems Maheshwaran, 1999, Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems Maheswaran, 1999, Dynamic mapping of a class of independent tasks onto heterogeneous computing systems, J. Parallel Distributed Comput., 59, 107, 10.1006/jpdc.1999.1581 Mohamed, 2004, An evaluation of the close-to-files processor and data co-allocation policy in multiclusters Park, 1996, On the relationship between file sizes S.-M. Park, J.-H. Kim, Chameleon: a resource scheduler in a data grid environment, in: Proceedings of the Third IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2003), IEEE CS Press, Los Alamitos, CA, USA, Tokyo, Japan, 2003. A. Rajasekar, M. Wan, R. Moore, MySRB & SRB: components of a data grid, in: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11), IEEE CS Press, Los Alamitos, CA, USA, Edinburgh, UK, 2002. Ranganathan, 2002, Decoupling computation and data scheduling in distributed data-intensive applications Ranganathan, 2003, Simulation studies of computation and data scheduling algorithms for data grids, J. Grid Comput., 1, 53, 10.1023/A:1024035627870 Salem, 1986, Disk striping Seidel, 2002, GridLab: a grid application toolkit and testbed, Future Generation Comput. Systems, 18, 1143, 10.1016/S0167-739X(02)00091-2 Shi, 2006, Scheduling workflow applications on processors with different capabilities, Future Generation Comput. Systems, 22, 665, 10.1016/j.future.2005.11.002 A. Sulistio, U. Cibej, B. Robic, R. Buyya, A tool for modelling and simulation of data grids with integration of data storage, Replication and Analysis, Technical Report GRIDS-TR-2005-13, University of Melbourne, Australia, November 2005. A. Sulistio, G. Poduval, R. Buyya, C.-K. Tham, On incorporating differentiated network service into GridSim, Technical Report GRIDS-TR-2006-5, The University of Melbourne, Australia, March 2006. Sulistio, 2004, A taxonomy of computer-based simulations and its mapping to parallel and distributed systems simulation tools, Software Practice and Experience (SPE), 34, 653, 10.1002/spe.585 Thakur, 1996, Passion: optimized I/O for parallel applications, Computer, 29, 70 S. Venugopal, R. Buyya, A deadline and budget constrained scheduling algorithm for e-science applications on data grids, in: Proceedings of the 6th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP-2005), Lecture Notes in Computer Science, vol. 3719, Springer-Verlag, Berlin, Germany, Melbourne, Australia, 2005. Venugopal, 2004, A grid service broker for scheduling distributed data-oriented applications on global grids Wolski, 1999, The network weather service: a distributed resource performance forecasting service for metacomputing, J. Future Generation Comput. Systems, 15, 757, 10.1016/S0167-739X(99)00025-4 Yamamoto, 2004, Parallel and distributed astronomical data analysis on grid datafarm