Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling

Tierney, L. (1994). Markov chains for exploring posterior distributions (with discussion). <i>Ann. Statist.</i> <b>22</b> 1701--1762.

Escobar, M. D. and West, M. (1995). Bayesian density estimation and inference using mixtures. <i>J. Amer. Statist. Assoc.</i> <b>90</b> 577--588.

Diebolt, J. and Robert, C. P. (1994). Estimation of finite mixture distributions through Bayesian sampling. <i>J. Roy. Statist. Soc. Ser. B</i> <b>56</b> 363--375.

Richardson, S. and Green, P. J. (1997). On Bayesian analysis of mixtures with an unknown number of components (with discussion). <i>J. Roy. Statist. Soc. Ser. B</i> <b>59</b> 731--792.

Rao, C. R. (1948). The utilization of multiple measurements in problems of biological classification (with discussion). <i>J. Roy. Statist. Soc. Ser. B</i> <b>10</b> 159--203.

Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. <i>Biometrika</i> <b>57</b> 97--109.

Baum, L. E. and Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. <i>Ann. Math. Statist.</i> <b>37</b> 1554--1563.

Robert, C. P. and Casella, G. (2004). <i>Monte Carlo Statistical Methods</i>, 2nd ed. Springer, New York.

Liu, J. S. (2001). <i>Monte Carlo Strategies in Scientific Computing</i>. Springer, New York.

Titterington, D. M., Smith, A. F. M. and Makov, U. E. (1985). <i>Statistical Analysis of Finite Mixture Distributions</i>. Wiley, Chichester.

Yeung, K. Y., Fraley, C., Murua, A., Raftery, A. E. and Ruzzo, W. L. (2001). Model-based clustering and data transformations for gene expression data. <i>Bioinformatics</i> <b>17</b> 977--987.

Green, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. <i>Biometrika</i> <b>82</b> 711--732.

Dempster, A., Laird, N. and Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). <i>J. Roy. Statist. Soc. Ser. B</i> <b>39</b> 1--38.

Aitkin, M. (2001). Likelihood and Bayesian analysis of mixtures. <i>Statistical Modeling</i> <b>1</b> 287--304.

Bartlett, M. S. (1957). A comment on D. V. Lindley's statistical paradox. <i>Biometrika</i> <b>44</b> 533--534.

Baum, L. E., Petrie, T., Soules, G. and Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. <i>Ann. Math. Statist.</i> <b>41</b> 164--171.

Beal, M. J., Ghahramani, Z. and Rasmussen, C. E. (2002). The infinite hidden Markov model. In <i>Neural Information Processing Systems</i> <b>14</b> (T. G. Diettrich, S. Becker and Z. Ghahramani, eds.) 577--584. MIT Press, Cambridge, MA.

Bernardo, J. M. and Giròn, F. J. (1988). A Bayesian analysis of simple mixture problems. In <i>Bayesian Statistics 3</i> (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 67--78. Oxford Univ. Press.

Boys, R. J. and Henderson, D. A. (2003). Data augmentation and marginal updating schemes for inference in hidden Markov models. Technical report, Univ. Newcastle.

Boys, R. J. and Henderson, D. A. (2004). A Bayesian approach to DNA sequence segmentation (with discussion). <i>Biometrics</i> <b>60</b> 573--588.

Cappé, O., Robert, C. P. and Rydén, T. (2001). Reversible jump MCMC converging to birth-and-death MCMC and more general continuous time samplers. Technical report, Univ. Paris Dauphine.

Cappé, O., Robert, C. P. and Rydén, T. (2003). Reversible jump, birth-and-death and more general continuous time Markov chain Monte Carlo samplers. <i>J. R. Stat. Soc. Ser. B Stat. Methodol.</i> <b>65</b> 679--700.

Casella, G., Mengersen, K. L., Robert, C. P. and Titterington, D. M. (2002). Perfect samplers for mixtures of distributions. <i>J. R. Stat. Soc. Ser. B Stat. Methodol.</i> <b>64</b> 777--790.

Celeux, G. (1997). Discussion of ``On Bayesian analysis of mixtures with an unknown number of components,'' by S. Richardson and P. J. Green. <i>J. Roy. Statist. Soc. Ser. B</i> <b>59</b> 775--776.

Celeux, G. (1998). Bayesian inference for mixtures: The label-switching problem. In <i>COMPSTAT 98---Proc. in Computational Statistics</i> (R. Payne and P. J. Green, eds.) 227--232. Physica, Heidelberg.

Celeux, G., Hurn, M. and Robert, C. P. (2000). Computational and inferential difficulties with mixture posterior distributions. <i>J. Amer. Statist. Assoc.</i> <b>95</b> 957--970.

Ciuperca, G., Ridolfi, A. and Idier, J. (2003). Penalized maximum likelihood estimator for normal mixtures. <i>Scand. J. Statist.</i> <b>30</b> 45--59.

Dellaportas, P. and Papageorgiou, I. (2004). Multivariate mixtures of normals with an unknown number of components. Technical report, Athens Univ.

Dellaportas, P., Stephens, D. A., Smith, A. F. M. and Guttman, I. (1996). A comparative study of perinatal mortality using a two-component mixture model. In <i>Bayesian Biostatistics</i> (D. A. Berry and D. K. Stangl, eds.) 601--616. Dekker, New York.

Fearnhead, P. (2004). Exact and efficient Bayesian inference for multiple changepoint problems. Technical report, Univ. Lancaster.

Frühwirth-Schnatter, S. (2001). Markov chain Monte Carlo estimation of classical and dynamic switching and mixture models. <i>J. Amer. Statist. Assoc.</i> <b>96</b> 194--209.

Green, P. J. (2003). Trans-dimensional Markov chain Monte Carlo. In <i>Highly Structured Stochastic Systems</i> (P. J. Green, N. L. Hjort and S. Richardson, eds.) 179--196. Oxford Univ. Press.

Green, P. J. and Richardson, S. (2002). Hidden Markov models and disease mapping. <i>J. Amer. Statist. Assoc.</i> <b>97</b> 1055--1070.

Gruet, M.-A., Philippe, A. and Robert, C. P. (1999). MCMC control spreadsheets for exponential mixture estimation. <i>J. Comput. Graph. Statist.</i> <b>8</b> 298--317.

Hurn, M., Justel, A. and Robert, C. P. (2003). Estimating mixtures of regressions. <i>J. Comput. Graph. Statist.</i> <b>12</b> 55--79.

Jasra, A., Stephens, D. A. and Holmes, C. C. (2005). Population-based reversible jump Markov chain Monte Carlo. Technical report, Imperial College London.

Jennison, C. (1997). Discussion of ``On Bayesian analysis of mixtures with an unknown number of components,'' by S. Richardson and P. J. Green. <i>J. Roy. Statist. Soc. Ser. B</i> <b>59</b> 778--779.

Liang, F. and Wong, W. H. (2001). Real parameter evolutionary Monte Carlo with applications to Bayesian mixture models. <i>J. Amer. Statist. Assoc.</i> <b>96</b> 653--666.

Lindley, D. V. (1957). A statistical paradox. <i>Biometrika</i> <b>44</b> 187--192.

Marin, J.-M., Mengersen, K. L. and Robert, C. P. (2005). Bayesian modelling and inference on mixtures of distributions. In <i>Bayesian Modelling and Inference on Mixtures of Distributions. Handbook of Statistics</i> <b>25</b> (D. Dey and C. R. Rao, eds.). North-Holland, Amsterdam.

McLachlan, G. J. and Peel, D. (2000). <i>Finite Mixture Models</i>. Wiley, Chichester.

Mengersen, K. L. and Robert, C. P. (1996). Testing for mixtures: A Bayesian entropic approach (with discussion). In <i>Bayesian Statistics 5</i> (J. O. Berger, J. M. Bernardo, A. P. Dawid, D. V. Lindley and A. F. M. Smith, eds.) 255--276. Oxford Univ. Press.

Neal, R. (1996). Sampling from multimodal distributions using tempered transitions. <i>Statist. Comput.</i> <b>4</b> 353--366.

Newcomb, S. (1886). A generalized theory of the combination of observations so as to obtain the best result. <i>Amer. J. Math.</i> <b>8</b> 343--366.

Pearson, K. (1894). Contribution to the mathematical theory of evolution. <i>Philos. Trans. Roy. Soc. London Ser. A</i> <b>185</b> 71--110.

Postman, M., Huchra, J. P. and Geller, M. J. (1986). Probes of large-scale structure in the Corona Borealis region. <i>Astronomical J.</i> <b>92</b> 1238--1246.

Robert, C. P. (1997). Discussion of ``On Bayesian analysis of mixtures with an unknown number of components,'' by S. Richardson and P. J. Green. <i>J. Roy. Statist. Soc. Ser. B</i> <b>59</b> 758--764.

Robert, C. P., Rydén, T. and Titterington, D. M. (2000). Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method. <i>J. R. Stat. Soc. Ser. B Stat. Methodol.</i> <b>62</b> 57--75.

Roeder, K. (1990). Density estimation with confidence sets exemplified by superclusters and voids in galaxies. <i>J. Amer. Statist. Assoc.</i> <b>85</b> 617--624.

Stephens, M. (1997a). Bayesian methods for mixtures of normal distributions. D.Phil. dissertation, Dept. Statistics, Univ. Oxford.

Stephens, M. (1997b). Discussion of ``On Bayesian analysis of mixtures with an unknown number of components,'' by S. Richardson and P. J. Green. <i>J. Roy. Statist. Soc. Ser. B</i> <b>59</b> 768--769.

Stephens, M. (2000a). Bayesian analysis of mixture models with an unknown number of components---An alternative to reversible jump methods. <i>Ann. Statist.</i> <b>28</b> 40--74.

Stephens, M. (2000b). Dealing with label switching in mixture models. <i>J. R. Stat. Soc. Ser. B Stat. Methodol.</i> <b>62</b> 795--809.

West, M. (1997). Discussion of ``On Bayesian analysis of mixtures with an unknown number of components,'' by S. Richardson and P. J. Green. <i>J. Roy. Statist. Soc. Ser. B</i> <b>59</b> 783--784.