Sample-Weighted Fuzzy Clustering with Regularizations

Authors: Miin-Shen Yang, Yee-Shan Pan

Abstract:

Although there have been many researches in cluster analysis to consider on feature weights, little effort is made on sample weights. Recently, Yu et al. (2011) considered a probability distribution over a data set to represent its sample weights and then proposed sample-weighted clustering algorithms. In this paper, we give a sample-weighted version of generalized fuzzy clustering regularization (GFCR), called the sample-weighted GFCR (SW-GFCR). Some experiments are considered. These experimental results and comparisons demonstrate that the proposed SW-GFCR is more effective than the most clustering algorithms.

Keywords: Clustering; fuzzy c-means, fuzzy clustering, sample weights, regularization.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1087153

References:

[1] L. Kaufman, P.J. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis. Wiley, New York, 1990.
[2] J. MacQueen, "Some methods for classification and analysis of multivariate observations,” in Proc. 5th Berkeley Symp. Math. Statist, Prob. 1, 1967, pp. 281-297.
[3] D. Pollard, "Quantization and the method of k-means,” IEEE Trans. Information Theory, vol. 28, pp. 199-205, 1982.
[4] J.C. Bezdek, J.C., Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York, 1981.
[5] M.S. Yang, "A survey of fuzzy clustering,” Mathematical and Computer Modeling, vol. 18, pp. 1-16, 1993.
[6] R. Krishnapuram, J. M. Keller, "A possibilistic approach to clustering,” IEEE Trans. Fuzzy Systems, vol. 1, pp. 98-110, 1993.
[7] M.S. Yang and C.Y Lai, "A robust automatic merging possibilistic clustering method,” IEEE Trans. on Fuzzy Systems, vol. 19, pp. 26-41, 2011.
[8] D.S. Modha and W.S. Spangler, "Feature weighting in k-means clustering,” Machine Learning, vol. 52, pp. 217-237, 2003.
[9] J.Z. Huang, M.K. Ng, H. Rong, and Z. Li, "Automated variable weighting in k-means type clustering,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, pp. 657-668, 2005.
[10] X.Z. Wang, Y.D. Wang, L.J. Wang, "Improving fuzzy c-means clustering based on feature-weight learning,” Pattern Recognition Letter, vol. 25, pp. 1123–1132, 2004.
[11] W.L. Hung, M.S. Yang and D.H. Chen, "Bootstrapping approach to feature-weight selection in fuzzy c-means algorithms with an application in color image segmentation,” Pattern Recognition Letters, vol. 29, pp. 1317-1325, 2008.
[12] J. Yu, M. S. Yang, E. S. Lee, "Sample-weighted clustering methods,” Computers and Mathematics with Applications, vol. 62 (2011) 2200-2208.
[13] J. Yu, M. S. Yang, "A generalized fuzzy clustering regularization model with optimality tests and model complexity analysis,” IEEE Transactions on Fuzzy Systems, vol. 15, pp. 904-915, 2007.
[14] C. Wei, C. Fahn, "The multisynapse neural network and its application to fuzzy clustering,” IEEE Transactions on Neural Networks, vol. 13, pp. 600-618, 2002.
[15] M. S. Yang, "On a class of fuzzy classification maximum likelihood procedures,” Fuzzy Sets Systems, vol. 57, pp. 365-375, 1993.
[16] D. Özdemir, L. Akarun, "A fuzzy algorithm for color quantization of images,” Pattern Recognition, vol. 35, pp. 1785-1791, 2002.
[17] M. Yasuda, T. Furuhashi, M. Matsuzaki, S. Okuma, "Fuzzy clustering using deterministic annealing method and its statistical mechanical characteristics,” in Proc. 10th IEEE International Conference on Fuzzy Systems, 2001, pp. 797-800.
[18] E. Anderson, "The IRISes of the Gaspe Peninsula,” Bull. Am. IRIS Soc., vol. 59, pp. 2-5, 1935.
[19] UCI machine learning repository, Center for Machine Learning and Intelligent Systems, Liver Disorders Data Set. Available from: http://archive.ics.uci.edu/ml/datasets/Liver+Disorders