Evolutionary Query Optimization for Heterogeneous Distributed Database Systems

Authors: Reza Ghaemi, Amin Milani Fard, Hamid Tabatabaee, Mahdi Sadeghizadeh

Abstract:

Due to new distributed database applications such as huge deductive database systems, the search complexity is constantly increasing and we need better algorithms to speedup traditional relational database queries. An optimal dynamic programming method for such high dimensional queries has the big disadvantage of its exponential order and thus we are interested in semi-optimal but faster approaches. In this work we present a multi-agent based mechanism to meet this demand and also compare the result with some commonly used query optimization algorithms.

Keywords: Information retrieval systems, list fusion methods, document score, multi-agent systems.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1080054

References:

[1] J. Callan, "Distributed information retrieval". In Advances in Information Retrieval, W. B. Croft, Ed. Kluwer Academic Publishers, 2000, pp. 127-150.
[2] L. Si, J. Callan, "A Semisupervised Learning Method to Merge Search Engine Results", ACM Transactions on Information Systems, Vol. 21, No. 4, October 2003, Pages 457-491.
[3] Li, Victor O. K. "Query processing in distributed data bases", MIT. Lab. for Information and Decision Systems Series/Report no.: LIDS-P ; 1107, 1981
[4] M. Tamer Özsu, Patrick Valduriez, "Principles of Distributed Database Systems, Second Edition", Prentice Hall, ISBN 0-13-659707-6, 1999
[5] Kristina Zelenay,"Query Optimization", ETH Z├╝rich, Seminar Algorithmen f├╝r Datenbanksysteme, June 2005
[6] Yannis E. Ioannidis and Youngkyung Cha Kang, "Randomized Algorithms for Optimizing Large Join Queries"
[7] Michael Steinbrunn, Guido Moerkotte, Alfons Kemper, "Heuristic and Randomized Optimization for the Join Ordering Problem", The VLDB Journal - The International Journal on Very Large Data Bases, Volume 6 , Issue 3 (August 1997), Pages: 191-208, ISSN:1066-8888
[8] D. Kossman, "The state of the art in distributed query processing" (ACM Computing Surveys, ISSN:0360-0300, 2000, Volume 32 , Issue 4 December 2000, Pages: 422 - 469
[9] P. Griffiths Selinger, M. M. Astrahan, D. D. Chamberlin, R. A. Lorie, T. G. Price, "Access path selection in a relational database management system", Morgan Kaufmann Series In Data Management Systems, Readings in database systems (3rd ed.), Pages: 141 - 152, 1998, ISBN:1- 55860-523-1
[10] Stocker, Kossman, Braumandl, Kemper , "Integrating semi join reducers into state of the art query processors", (ICDE 2001)
[11] Stefano Ceri, Giuseppe Pelagatti, "Distributed Databases: Principles and Systems", Mcgraw-Hill, ISBN-10: 0070108293, ISBN-13: 978- 0070108295, 1984
[12] The Design and Implementation of Distributed INGRES (context) - Stonebraker - 1986
[13] Patricia G. Selinger, Michel E. Adiba, "Access Path Selection in Distributed Database Management Systems", ICOD 1980: 204-215
[14] M. Wooldridge, "An Introduction to Multiagent Systems" Published in February 2002 by John Wiley & Sons. ISBN 0 47149691X.
[15] M. R. Genesereth, R. E. Fikes, "Knowledge interchange format", version 3.0. Technical Report 92-1, Stanford University, Computer Science Departament, 1992
[16] T. Finin, R. Fritzson, D. McKay, R. McEntire,"KQML as an Agent Communication Language", Proceedings of the 3rd International Conference on Information and Knowledge Management (CIKM'94), ACM Press,Gaithersburg, MD, USA, editor N. Adam, B. Bhargava, Y. Yesha, pp 456-463, 1994
[17] Y. Labrou, T. Finin, Y. Peng, "The current landscape of Agent Communication Languages", The current landscape of Agent Communication Languages, Intelligent Systems, volume 14, number 2, March/April 1999, IEEE Computer Society, 1999
[18] A. Korzyk, "Towards XML As A Secure Intelligent Agent Communication Language", the 23rd National Information Systems Security Conference, Baltimore Convention Center, Baltimore, Maryland, SA, October 16-19, 2000
[19] Huang, Kuan-Tsae, Davenport, Wilbur B., "Query processing in distributed heterogeneous databases", MIT. Laboratory for Information and Decision Systems Series/Report no.: LIDS-P ;1212 , 1981
[20] F. Bellifemine, G. Caire, T. Trucco, G. Rimassa, "JADE Programmer-s Guide", 21-August-2006.
[21] JADE Board, "JADE WSIG Add-On Guide JADE Web Services Integration Gateway (WSIG) Guide", 03-March-2005
[22] E. Cortese, F. Quarta, G. Vitaglione, P. Vrba. "Scalability and Performance of the JADE Message Transport System". Analysis of Suitability for Holonic Manufacturing Systems, exp, 2002.
[23] S. Liu, P. K├╝ngas, M. Matskin, "Agent-Based Web Service Composition with JADE and JXTA", Proceedings of the 2006 International Conference on Semantic Web and Web Services, SWWS 2006, Las Vegas, Nevada, USA, June 26-29, 2006
[24] J. D. Gradecki, "Mastering JXTA: Building Java Peer-to-Peer Applications", JohnWiley&Sons,2002.
[25] J. H. Holland, "Adaptation in natural and artificial systems", Ann Arbor, MI University of Michigan Press 1975.
[26] D. E. Goldberg, "The genetic algorithms in search, optimization, and machine learning", New Y7ork: Addison-Wesley, 1989.
[27] PostgreSQL 8.3.0 Documentation, Chapter 49. Genetic Query Optimizer http://www.postgresql.org/docs/8.3/interactive/geqo.html