Metadata Update Mechanism Improvements in Data Grid

Authors: S. Farokhzad, M. Reza Salehnamadi

Abstract:

Grid environments include aggregation of geographical distributed resources. Grid is put forward in three types of computational, data and storage. This paper presents a research on data grid. Data grid is used for covering and securing accessibility to data from among many heterogeneous sources. Users are not worry on the place where data is located in it, provided that, they should get access to the data. Metadata is used for getting access to data in data grid. Presently, application metadata catalogue and SRB middle-ware package are used in data grids for management of metadata. At this paper, possibility of updating, streamlining and searching is provided simultaneously and rapidly through classified table of preserving metadata and conversion of each table to numerous tables. Meanwhile, with regard to the specific application, the most appropriate and best division is set and determined. Concurrency of implementation of some of requests and execution of pipeline is adaptability as a result of this technique.

Keywords: Grids, data grid, metadata, update.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1328132

References:

[1] A. Rajasekar, M. Wan, R. Moore, '' MySRB & SRB components of a Data Grid'', 2002.
[2] G. Ganger, Y.PATT, "Metadata update performance in file systems". In Proceedings of the 1st USENIX Symposium on Operating Systems Design and Implementation (OSDI -94, Monterey, CA, Nov.), USENIX Assoc., Berkeley, CA, 49-60. 1994.
[3] D. Haynes, "Metadata for information management and retrieval. London: Facet Publishing. 2004.
[4] R. HAGMANN, Re-implementing the cedar file system Using logging and group commit. In Proceedings of the Eleventh ACM Symposium on Operating systems Principles (Austin, TX, Nov. 8-11, 1987), L. Belady, Ed. ACM Press, New York, NY, 155-162. 1987.
[5] K. Kaczmarski, Piotr Habela, K. Subieta, ''Metadata in A Data Grid Construction'', Proc. Of the 13th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, 2004.
[6] M. Aldinucci, M. Danelutto, G. Giaccherini, M. Torquati, M. Venneschi ,'' wards a Distributed Scalable Data Service for the Grid '',John von Neumann Institute for Computing, J¨ulich, NIC Series, Vol. 33, pp. 73-80, 2006.
[7] O.A. Rahmeh, P. Johnson, "Towards scalable and Reliable Grid Networks", IEEE 2008.
[8] S. Venuyopal, Rajkumar Buyya, kotagiri Ramamohanarao, A Taxonomy of Data Grids for Distributed Management and processing" ,ACM computing surveys, Vol.38, March 2006.
[9] V. Silva, '' Build a data grid with the Storage Resource Broker'', IBM, 2007.
[10] M. WU, W. ZWAENEPOEL, "A non-volatile, main Memory storage system. In Proceedings of the 6th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS VI, San Jose, CA, Oct. 4-7 ACM Press, NY, 86-97. 1994.
[11] Won Kim, "On Metadata Management Technology Status and Issues", in Journal of Object Technology, vol. 4, no. 2, March-April 2005, pp. 41-47.