An Improved Resource Discovery Approach Using P2P Model for Condor: A Grid Middleware

Authors: Anju Sharma, Seema Bawa

Abstract:

Resource Discovery in Grids is critical for efficient resource allocation and management. Heterogeneous nature and dynamic availability of resources make resource discovery a challenging task. As numbers of nodes are increasing from tens to thousands, scalability is essentially desired. Peer-to-Peer (P2P) techniques, on the other hand, provide effective implementation of scalable services and applications. In this paper we propose a model for resource discovery in Condor Middleware by using the four axis framework defined in P2P approach. The proposed model enhances Condor to incorporate functionality of a P2P system, thus aim to make Condor more scalable, flexible, reliable and robust.

Keywords: Condor Middleware, Grid Computing, P2P, Resource Discovery.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1075519

References:

[1] Yili Gong, Wei Li, Yuzhong Sun, Zhiwei Xu, "A C/S and P2P Hybrid Resource Discovery Framework in Grid Enviornments", ICPP 2005, pp. 261-268.
[2] Carlo Mastroianni, Domenico Talia and Oreste Verta, "A P2P Approach for Membership Management and Resource Discovery in Grids", ITCC 2005, Volume II, pp. 168-174.
[3] Sanya Tangpongprasit, Takahiro Katagiri, Kenji Kise, Hiroki Honda, Toshitsugu Yuba, "A time-to-live based reservation algorithm on fully decenteralized resource discovery in Grid Computing" Elsevier Parallel Computing 31, 2005, pp 529-543.
[4] G. Coulouris, J. Dollimore, T. Kindberg, "Distributed Systems: Concepts and Design", Addison-Wesley, 2001, 772p.
[5] S. Fitzgerald, I. Foster, C. Kesselman, G. Von Laszewski, W.Smith, S. Tuecke. A directory Service for Configuring High Performance Distributed Computations. Proc. 6th IEEE Symposium on High Performance Distributed Computing, pp. 365-375, 1997.
[6] S. jayasena, C. Yee, J. Song, A. Stoelwinder, C. W. See and W. Wong, " Data Resource Discovery in a Computational Grid", Proceeding of the Grid and Cooperative Computing International Workshops, 2004, pp. 303-310.
[7] T. Sandholm, J. Gawor, " lobusToolkit3 Core - "A Grid Service Container Framework", Technical Report, available at wwwunix. globus.org/toolkit/3.0/ogsa/docs/gt3_core.pdf,pp. 22.
[8] R. Wolski, N. Spring and J. Hayes, "The Network Weather Service: A Distributed Resource Performance Forcasting Service for Metacomputing", Future Generation Computer Systems, vol. 15, no. 5-6, pp. 746-768, October 1999.
[9] Y. Gong, F. Dong, W. Li and Z.Xu, Vega Infrastructure for Resource Discovery in Grids. Journal of Computer Science Technology, 18(4): 413-422, July 2003.
[10] C. A. Lee, J. Stepanek, R. Wolski, C. Kelleseman and I. Foster. " A Network Performance Tool for Grid Environments", In Proceeding of 7th IEEE Internatinal Symposium on High Performance Distributed Computung, pp 260-267, 1998.
[11] R. Buyya, D. Abramson and J. Giddy, Nimrod/G: "An Architecture for a Resource Management and Sheduling Syatem in a Global Computational Grid", Proceding of the High Performance Computing in the Asia-Pacific Region, China, pp 283-289, 2000.
[12] http://www.cs.wisc.edu/condor/
[13] Rajesh Raman, Miron Livny, Marvin Solomon, "Matchmaking: Distributed Resource Management for High Throughput Computing", HPDC 1998.
[14] http://www.cs.wisc.edu/condor/manual/v6.6.10
[15] Saroiu, S., Gummadi, P.K. and Gribble, S.D. (2002), "A measurement study of peer-to-peer file sharing systems", Proceedings of Multimedia Computing and Networking 2002 (MMCN-02), San Jose, CA, 18-25 January.
[16] Fitzgerald, S., Foster, I., Kesselman, C., von Laszewski, G., Smith, W. and Tuecke, S., "A directory service for configuring high-performance distributed computations", Proceedings of the 6th IEEE Symposium on High Performance Distributed Computing, Portland, OR, 1997, pp. 365- 76.
[17] Ripeanu, M., Peer-to-Peer Architecture Case Study: Gnutella Network, University of Chicago Technical Report TR-2001-26, University of Chicago, Chicago, IL, 2001.
[18] Iamnitchi and I. Foster, "On Fully Decentralized Resource Discovery in Grid Environments," IEEE International Workshop on Grid Computing,Denver, CO, 2001.
[19] Iamnitchi, I. Foster, Daniel C. Nurmi, "A Peer-to-Peer Approach to Resource Discovery in Grid Environments," Proc. of the 11th Symposium on High Performance Distributed Computing, Edinburgh, UK, 2002.
[20] W. Hoschek, "A Unified Peer-to-Peer Database Framework for Scalable Service and Resource Discovery," Proc. of Third International Workshop on Grid Computing: GRID 2002, Baltimore, MD. , Springer, 2002, pp. 126-144.
[21] http://www.marketingterms.com/dictionary/hybrid_model
[22] A.I. Iamnitchi, "Resource Discovery in Large Resource Sharing Environments", Chicago Illinois, 2003.
[23] M. Harchol-Balter, T. Leighton, D. Lewin, "Resource Discovery in Distributed Networks," 18th ACM Symposium on Principles of Distributed Computing, 1999.
[24] Nick Antonopoulos and James Salter, "Efficient resource discovery in Grids and P2P networks".
[25] Adriana Iamnitchi1 and Ian Foster, "A Peer-To-Peer Approach to Resource Location in Grid Environments".