An Optimal Task Selection Scheme for Hadoop Scheduling

Jeffrey Dean, 2008, MapReduce: Simplified data processing on large clusters, Communications of the ACM, 51, 107, 10.1145/1327452.1327492 Michael, 2007, Dryad: distributed data-parallel programs from sequential building blocks, ACM SIGOPS Operating Systems Review, 41, 59, 10.1145/1272998.1273005 Jaliya, 2010, Twister: a runtime for iterative MapReduce, In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, 810 Yunhong Gu Robert, 2009, Sector and sphere: the design and implementation of a high-performance data cloud, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 367, 2429, 10.1098/rsta.2009.0053 Apache Hadoop. http://hadoop.apache.org/. Hadoop's Capacity Scheduler: http://hadoop.apache.org/docs/stable/capacity_scheduler.html. Hadoop's Fair Scheduler: http://hadoop.apache.org/docs/stable/fair_scheduler.html. Zaharia, 2008, Improving MapReduce performance in heterogeneous environments, In Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI) Zaharia, 2010, Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling, In Proceedings of the 5th European Conference on Computer systems (EuroSys), 10.1145/1755913.1755940 Kc, 2010, Scheduling Hadoop Jobs to Meet Deadlines, in Proc. CloudCom, 388 Thirmala Rao, 2011, LSS. Reddy. Survey on Improved Scheduling in Hadoop MapReduce in Cloud Environments, International Journal of Computer Applications, 34, 29