Computing Low Latency Batches with Unreliable Workers in Volunteer Computing Environments

E. M. Heien1, David P. Anderson2, Kenichi Hagihara1
1Graduate School of Information Science and Technology, Osaka University, Suita, Japan
2University of California Berkeley, Berkeley, USA

Tóm tắt

Từ khóa


Tài liệu tham khảo

Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: Seti@home: an experiment in public-resource computing. Commun. ACM 45(11), 56–61 (2002)

Larson, S.M., Snow, C.D., Shirts, M., Pande, V.S.: Folding@home and genome@home: using distributed computing to tackle previously intractable problems in computational biology. In: Modern Methods in Computational Biology. Horizon, Marseille (2003)

Valiant, L.: A bridging model for parallel computation. Commun. ACM 33(8) (1990)

Schopf, J.M., Berman, F.: Stochastic scheduling. In: Supercomputing ’99: Proceedings of the 1999 ACM/IEEE Conference on Supercomputing (CDROM), p. 48. ACM, New York (1999)

Budati, K., Sonnek, J., Chandra, A., Weissman, J.: Ridge: combining reliability and performance in open grid platforms. In: HPDC ’07: Proceedings of the 16th International Symposium on High Performance Distributed Computing, pp. 55–64. ACM, New York (2007)

Kondo, D., Chien, A.A., Casanova, H.: Resource management for rapid application turnaround on enterprise desktop grids. In: SC ’04: Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, p. 17. IEEE Computer Society, Washington, DC (2004)

Rood, B., Lewis, M.J.: Scheduling on the grid via multi-state resource availability prediction. In: 9th IEEE/ACM International Conference on Grid Computing, 2008, pp. 126–135 (2008)

Kondo, D., Taufer, M., Brooks, C., Casanova, H., Chien, A.: Characterizing and evaluating desktop grids: an empirical study. In: 2004 Proceedings of the 18th International Parallel and Distributed Processing Symposium, p. 26 (2004)

Malecot, P., Kondo, D., Fedak, G.: Xtremlab: a system for characterizing internet desktop grids. In: 2006 15th IEEE International Symposium on High Performance Distributed Computing, pp. 357–358 (2006)

Golle, P., Mironov, I.: Uncheatable distributed computations. In: Proceedings of the 2001 Conference on Topics in Cryptology: The Cryptographer’s Track at RSA, vol. 2020, pp. 425–440 (2001)

Sonnek, J., Chandra, A., Weissman, J.B.: Adaptive reputation-based scheduling on unreliable distributed infrastructures. IEEE Trans. Parallel Distrib. Syst. 18(11), 1551–1564 (2007)

Anderson, D.P.: Boinc: a system for public-resource computing and storage. In: GRID ’04: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, pp. 4–10. IEEE Computer Society, Washington, DC (2004)

Kondo, D., Andrzejak, A., Anderson, D.P.: On correlated availability in internet-distributed systems. In: 9th IEEE/ACM International Conference on Grid Computing, 2008, pp. 276–283 (2008)

Anderson, D.P., Fedak, G.: The computational and storage potential of volunteer computing. In: CCGRID ’06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, pp. 73–80. IEEE Computer Society, Washington, DC (2006)

Kondo, D., Fedak, G., Cappello, F., Chien, A.A., Casanova, H.: Resource availability in enterprise desktop grids. Future Gener. Comput. Syst. 23(7), 888–903 (2007)

Nurmi, D., Brevik, J., Wolski, R.: Modeling machine availability in enterprise and wide-area distributed computing environments. In: Euro-Par05, pp. 432–441 (2005)

Andrzejak, A., Kondo, D., Anderson, D.P.: Ensuring collective availability in volatile resource pools via forecasting. In: DSOM ’08: Proceedings of the 19th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management, pp. 149–161. Springer, Berlin (2008)

Heien, E., Fujimoto, N., Hagihara, K.: Computing low latency batches with unreliable workers in volunteer computing environments. In: IEEE International Symposium on Parallel and Distributed Processing. IPDPS 2008, pp. 1–8 (2008)

Stephens, M.A.: Edf statistics for goodness of fit and some comparisons. J. Am. Stat. Assoc. 69(347), 730–737 (1974)

Parzen, E.: Stochastic Processes. Society for Industrial and Applied Mathematics, Philadelphia (1999)

Byun, E., Choi, S., Baik, M., Hwang, C., Park, C., Jung, S.Y.: Scheduling scheme based on dedication rate in volunteer computing environment. In: The 4th International Symposium on Parallel and Distributed Computing. ISPDC 2005, pp. 234–241 (2005)

Kondo, D., Kindarji, B., Fedak, G., Cappello, F.: Towards soft real-time applications on enterprise desktop grids. In: CCGRID ’06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, pp. 65–72. IEEE Computer Society, Washington, DC (2006)

Kondo, D., Araujo, F., Domingues, P., Silva, L.: Validating desktop grid results by comparing intermediate checkpoints. Technical Report TR-0059 (2006)

Christensen, C., Aina, T., Stainforth, D.: The challenge of volunteer computing with lengthy climate model simulations. In: First International Conference on e-Science and Grid Computing, pp. 8–15 (2005)

Estrada, T., Fuentes, O., Taufer, M.: A distributed evolutionary method to design scheduling policies for volunteer computing. In: CF ’08: Proceedings of the 2008 Conference on Computing Frontiers, pp. 313–322. ACM, New York (2008)

Murata, Y., Inaba, T., Takizawa, H., Kobayashi, H.: Implementation and evaluation of a distributed and cooperative load-balancing mechanism for dependable volunteer computing. In: IEEE International Conference on Dependable Systems and Networks With FTCS and DCC. DSN 2008, pp. 316–325 (2008)