Abstract

Fuzzy c-means (FCM) is an important clustering algorithm. However, it does not consider the impact of different feature on clustering. In this paper, we present a fuzzy clustering algorithm with the generalized entropy of feature weights FCM (GEWFCM). By introducing feature weights and adding regularized term of their generalized entropy, a new objective function is proposed in terms of objective function of FCM. In GEWFCM, minimization of the dispersion within clusters and maximization of the generalized entropy of feature weights simultaneously obtain the optimal clustering results. Moreover, GEWFCM is viewed as a generalization of the maximum entropy-regularized weighted FCM (EWFCM). Experiments on data sets selected from University of California Irvine (UCI) machine learning repository demonstrate the effectiveness of presented method.

Keyword

Fuzzy clustering, Fuzzy entropy, Generalized fuzzy entropy, Feature weights.

Cite this article

Refference

[1][1]Huang JZ, Ng MK, Rong H, Li Z. Automated variable weighting in k-means type clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence.2005; 27(5):657-68.

[2][2]Renato CA, Boris M. Minkowski metric, feature weighting and anomalous clustering initializing in K-Means clustering. Pattern Recognition. 2012;45(3):1061-75.

[3][3]Dave RN, Bhaswan K. Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Transactions on Neural Networks.1992; 3(5):643-62.

[4][4]Bobrowski L, Bezdek JC. C-means clustering with the ll and l∞ norms. IEEE Transactions on Systems, Man, and Cybernetics. 1991; 21(3):545-54.

[5][5]Lin PL, Huang PW, Kuo CH, Lai YH. A size-insensitive integrity-based fuzzy c-means method for data clustering. Pattern Recognition. 2014;47(5):2042-56.

[6][6]Karayiannis NB. MECA: maximum entropy clustering algorithm. Proceedings of the third IEEE conference on world congress on computational intelligence 1994 (pp. 630-5). IEEE.

[7][7]Li RP, Mukaidono M. A maximum-entropy approach to fuzzy clustering. International joint conference of the fourth IEEE conference on fuzzy systems and the second international fuzzy engineering symposium 1995(pp. 2227-32). IEEE.

[8][8]Fu H, Elmisery AM. A new feature weighted fuzzy c-means clustering algorithm. Algarve, Portugal. 2009.

[9][9]Li J, Gao X, Jiao L. A new feature weighted fuzzy clustering algorithm. In international workshop on rough sets, fuzzy sets, data mining, and granular-soft computing 2005 (pp. 412-20). Springer Berlin Heidelberg.

[10][10]Zhou J, Chen L, Chen CP, Zhang Y, Li HX. Fuzzy clustering with the entropy of attribute weights. Neurocomputing. 2016; 198: 125-34.

[11][11]Lichman M. UCI machine learning repository. School Information Computer Science, University of California, Irvine, CA, USA. http://archive.ics.uci.edu/ml. Accessed 15 May 2016.