Cloud agnostic Big Data platform focusing on scalability and cost-efficiency

Advances in Engineering Software - Tập 125 - Trang 167-177 - 2018
Róbert Lovas1, Enikő Nagy1, József Kovács1
1Institute for Computer Science and Control, Hungarian Academy of Sciences (MTA SZTAKI), Budapest, Hungary

Tài liệu tham khảo

Bajaber, 2016, Big data 2.0 processing systems: taxonomy and open challenges, J Grid Comput, 14, 379, 10.1007/s10723-016-9371-1 Mell, 2011, The NIST definition of cloud computing, national institute of standards & technology, gaithersburg, MD SZTAKI cloud project homepage. http://cloud.sztaki.hu/en/home [30/08/2017]. MTA cloud project homepage. http://cloud.mta.hu [30/08/2017]. Fernndez-del Castillo, 2015, The EGI federated cloud e-infrastructure, Procedia Comput Sci, 68, 196, 10.1016/j.procs.2015.09.235 2017, Amazon web services, inc., Overv Amazon Web Serv Vavilapalli, 2013, Apache hadoop YARN: yet another resource negotiator Merkel, 2014, Docker: lightweight linux containers for consistent development and deployment, Linux J Chauhan, 2014 Amazon elastic mapreduce. http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-what-is-emr.html[30/08/2017]. Moreno-Vozmediano, 2012, Iaas cloud architecture: from virtualized datacenters to federated cloud infrastructures, IEEE Comput, 45, 65, 10.1109/MC.2012.76 Sefraoui, 2012, Openstack: toward an open-source solution for cloud computing, Int J Comput Appl, 55 Dean, 2008, Simplified data processing on large clusters, Commun ACM, 51, 107113, 10.1145/1327452.1327492 Li, 2013, Hadoop-based ARIMA algorithm and its application in weather forecast, Int J Database Theory Appl, 6, 119132 Schatz, 2009, Cloudburst: highly sensitive read mapping with mapreduce, Bioinformatics, 25, 1363, 10.1093/bioinformatics/btp236 Jiao, 2012, Molecular dynamics simulation: implementation and optimization based on hadoop, 12031207 Shvachko, 2010, The hadoop distributed file system, 1 Kecskeméti, 2014, One click cloud orchestrator: bringing complex applications effortlessly to the clouds, 8806, 38 Kovacs, 2017, Orchestrating federated clouds by occopus Lovas, 2017, Cloud agnostic orchestration for big data research platforms, vol. 15 Mapreduce. http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html[28/2/2017]. Occopus. http://occopus.lpds.sztaki.hu [30/08/2017]. Gugnani, 2016, Extending science gateway frameworks to support big data applications in the cloud, J Grid Comput, 10.1007/s10723-016-9369-8 Google cloud dataproc. https://cloud.google.com/dataproc [30/08/2017]. 2015, Hortonworks inc., Cloudbreak 2017, Prometheus, Monitor Syst Time Ser Database Boncea R., Bacivarov I.. A system architecture for monitoring the reliability of iot. 2016. CloudSigma website. http://cloudsigma.com[30/08/2017]. Kacsuk, 2012, WS-PGRADE/gUSE generic DCI gateway framework for a large variety of user communities, J Grid Comput, 10, 601630, 10.1007/s10723-012-9240-5 von Laszewski, 2014, Accessing multiple clouds with cloudmesh, 21 Loughran, 2012, Dynamic deployment of a mapreduce architecture in the cloud, IEEE Internet Comput, 16, 40, 10.1109/MIC.2011.163 Consul by HashiCorp https://www.consul.io/. Babu, 2010, Towards automatic optimization of mapreduce programs, 137 Wang, 2009, Using realistic simulation for performance analysis of mapreduce setups, 19 Apache hadoop HDFS architecture guide. https://hadoop.apache.org/docs/r1.2.1/hdfs_design.