Clustering Using Finite Geometric Skew Normal Mixture Models

Deepana R¹ , Kiruthika C²

Section:Research Paper, Product Type: Isroset-Journal
Vol.6 , Issue.3 , pp.136-143, Jun-2019

CrossRef-DOI:   https://doi.org/10.26438/ijsrmss/v6i3.136143

Online published on Jun 30, 2019

Copyright © Deepana R , Kiruthika C . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
 

View this paper at   Google Scholar | DPI Digital Library

XML View     PDF Download

How to Cite this Paper

334 Views    154 Downloads    112 Downloads

Abstract :
Finite mixtures of non-normal distributions using model based clustering approach have emerged as an effective tool in modeling heterogeneous data with asymmetric features. In particular, an attention is paid to the geometric skew normal mixture models which have been used for skewed data. Parameter estimation is carried out using Expectation Maximization (EM) algorithm. Euclidean distance based initialization technique is used for finding initial mixing proportion values. Bayesian Information Criterion (BIC) and Akaike Information Criterion (AIC) are used to identify the optimal model. The clustering performance of these mixture models have been illustrated with the help of real and simulated datasets.

Key-Words / Index Term :
Geometric skew normal distribution, Finite Mixture Model, Model based Clustering, EM algorithm.

References :
Probability and Statistics, 2011.
[2]. B.S. Everitt, D.J. Hand, “Finite Mixture Distributions”, Chapman and Hall, London, 1981.
[3]. D. Titterington, A. Smith and U. Makov, “Statistical Analysis of Finite Mixture Distributions”, John Wiley and Sons, New York, 1985.
[4]. G.J. McLachlan, K.E. Basford, “Mixture Models: Inference and Applications”, Marcel Dekker, New York, 1988.
[5]. B.G. Lindsay, “Mixture Models: Theory, Geometry, and Applications”, NSF-CBMS Regional Conference Series in probability and Statistics, No. 5, (Institute of Mathematical Statistics and the American Statistical Association), Alexandria, VA, 1995.
[6]. G.J. McLachlan, D. Peel, “Finite Mixture Models”, John Wiley and Sons, Inc, New York, 2000.
[7]. S. Fruhwirth - Schnatter, “Finite mixture and Markov switching models”, Springer, New York, 2006.
[8]. J.D. Banfield, A.E. Raftery, “Model-based Gaussian and non-Gaussian clustering”, Biometrics, Vol. 49, Issue. 3, pp. 803-821, 1993.
[9]. V.Melnykov, R. Maitra, “Finite Mixture Models and Model Based Clustering”, Statistics Surveys, Vol. 4, pp. 80-116, 2010.
[10]. D. Stahl, H. Sallis, “Model-Based Cluster Analysis” Wiley Interdisciplinary Reviews: Computational Statistics, Vol. 4, Issue. 4, pp. 341–358, 2012.
[11]. P.D. McNicholas, “Model-Based Clustering” Journal of Classification, Vol. 33, Issue. 3, pp. 331–373, 2016.
[12]. A. Azzalini, “A class of distributions which includes the normal ones”, Scandinavian journal of Statistics (Theory and Applications), Vol. 12, Issue. 2, pp. 171-178, 1985.
[13]. X.L. Lee, G.J. McLachlan, “On mixtures of skew normal and skew t-distributions”, Advances in Data Analysis and Classification, Vol. 7, Issue. 3, pp. 241-266, 2013a.
[14]. X.L. Lee, G.J. McLachlan, “Model-based clustering and classification with non-normal mixture distributions”, Statistical Methods and Applications, Vol. 22, Issue. 4, pp. 427-454, 2013b.
[15]. X.L. Lee, G.J. McLachlan, “Finite mixtures of multivariate skew t-distributions some recent and new results”, Statistics and Computing, Vol. 24, Issue. 2, pp. 181-202, 2014.
[16]. A.O. Hagen, B.T. Murphy, I.C. Gormley, P.D. McNicholas and D. Karlis, “Clustering with the multivariate normal inverse Gaussian distribution”, Computational Statistics and Data Analysis, Vol. 93, No. C, pp.18 – 30, 2016.
[17]. D. Kundu, “Geometric Skew Normal Distribution”, Sankhya: The Indian Journal of Statistics, Vol. 76, No. B, Issue. 2, pp.167-189, 2014.
[18]. A.P. Dempster, N.M. Laird and D.B. Rubin, “Maximum likelihood for incomplete data via the EM algorithm”, Journal of the Royal Statistical Society (Series B), Vol. 39, pp. 1–38, 1977.
[19]. C. Biernachi, G. Celeux and Govaert, “Choosing starting values for the EM algorithm for getting highest likelihood in Multivariate Gaussian mixture models”, Computational Statistics and Data Analysis, Vol. 41, Issue. 3, pp. 561-575, 2003.
[20]. C. Biernachi, “Initializing EM using the properties of its trajectories in Gaussian mixtures”, Statistics and Computing, Vol. 14, Issue. 3, pp. 267-279, 2004.
[21]. T.I. Lin, J.C. Lee, and W.J. Hsieh, “Robust mixture modeling using the skew t distribution”, Statistics and Computations, Vol.17, Issue. 2, pp. 81–92, 2007.
[22]. S. Pyne, X. Hu, K. Wang, E. Rossin, T.I. Lin, L.M. Maier, C. Baecher-Allan, G.J. McLachlan, P. Tamayo, D.A. Hafler, P.L. De Jager, and J.P. Mesirow , “Automated high-dimensional flow cytometric data analysis”, Proceedings of the National Academy of Sciences USA, No. 106, pp. 8519–8524, 2009.
[23]. G. Schwarz, “Estimating the dimension of the model”, Annals of Statistics, Vol. 6, Issue. 2, pp. 461-464, 1978.
[24]. H. Akaike, “Information theory and an extension of the maximum likelihood principle”, Proceeding of the second international symposium on information theory, B.N Petrov and F. Caski, eds., Akademiai Kiado, Budapest, pp. 267-281, 1973.
[25]. L. Hubert, P. Arabie, “Comparing partitions”, Journal of Classification, Vol. 2, Issue. 1, pp. 193–218, 1985.
[26]. B. Flury, H. Riedwyl, “Multivariate Statistics: A practical approach”, London, Chapman and Hall, 1988.