Induction of Expressive Rules using the Binary Coding Method

Authors: Seyed R Mousavi

Abstract:

In most rule-induction algorithms, the only operator used against nominal attributes is the equality operator =. In this paper, we first propose the use of the inequality operator, ≠, in addition to the equality operator, to increase the expressiveness of induced rules. Then, we present a new method, Binary Coding, which can be used along with an arbitrary rule-induction algorithm to make use of the inequality operator without any need to change the algorithm. Experimental results suggest that the Binary Coding method is promising enough for further investigation, especially in cases where the minimum number of rules is desirable.

Keywords: Data mining, Inequality operator, Number of rules, Rule-induction.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1073643

References:

[1] C. L. Blake and C. J. Merz, "UCI repository of machine learning databases (http://www.ics.uci.edu/~mlearn/MLRepository.html)," Irvine, CA: University of California, Department of Information and Computer Science, 1998.
[2] P. Smyth and R. M. Goodman, "An information theoretic approach to rule induction from databases," IEEE Trans. Knowledge Data Engineering, vol. 4, pp. 301-316, 1992.
[3] P. Clark and R. Boswell, "Rule induction with CN2: some recent improvements," in Proc. 5th European Conf.( EWSL-91) Ed.: Yves kodratoff Springer-Verlag, Berlin, pp. 151-163, 1991.
[4] J. Cendrowska, "PRISM: an algorithm for inducing modular rules," Int. J. Man-Machine Studies, vol. 27, pp. 349-370, 1987.
[5] M. A. Bramer, "Using J-pruning to reduce overfitting in classification trees" Research and Development in Intelligent Systems, vol. XVIII, Springer-Verlag, pp. 25-38, 2000.
[6] J. R. Quinlan, "Induction of decision trees," Machine Learning, vol. 1, pp. 81-106, 1986.
[7] J. R. Quinlan, C4.5: programs for machine learning. Morgan Kaufmann, 1993.
[8] M. A. Bramer, "The Inducer user guide and reference manual," University of Portsmouth, Faculty of Technology, UK, Tech. Rep., 1999.
[9] M. A. Bramer, "Inducer: a rule induction workbench for data mining," In Z. Shi, B. Faltings and M. Musen, editors, Proc. 16th IFIP World Computer Congress Conf. Intelligent Information Processing, Publishing House of Electronics Industry (Beijing), pp. 499-506, 2000.