Statistical Inference in Missing Data by MCMC and Non-MCMC Multiple Imputation Algorithms: Assessing the Effects of Between-Imputation Iterations

Masayoshi Takahashi

doi:10.5334/dsj-2017-037

Statistical Inference in Missing Data by MCMC and Non-MCMC Multiple Imputation Algorithms: Assessing the Effects of Between-Imputation Iterations

Data Science Journal

Volume 16 (2017): Issue 0

By: Masayoshi Takahashi

Open Access

|Jul 2017

Abe T Iwasaki M Evaluation of statistical methods for analysis of small-sample longitudinal clinical trials with dropouts Journal of the Japanese Society of Computational Statistics 2007 20 1 1 18 10.5183/jjscs1988.20.1
Open DOI Search in Google Scholar Back to article
Acemoglu D Johnson S Robinson J A Aghion P Durlauf S Institutions as the fundamental cause of long-run growth Handbook of Economic Growth 2005 North Holland Elsevier
Search in Google Scholar Back to article
Allison P D Missing Data 2002 Thousand Oaks, CA Sage Publications 10.4135/9781412985079
Open DOI Search in Google Scholar Back to article
Baraldi A N Enders C K An introduction to modern missing data analyses Journal of School Psychology 2010 48 1 5 37 10.1016/j.jsp.2009.10.001
Open DOI Search in Google Scholar Back to article
Barnard J Rubin D B Small-sample degrees of freedom with multiple imputation Biometrika 1999 86 4 948 955 10.1093/biomet/86.4.948
Open DOI Search in Google Scholar Back to article
Barro R J Determinants of Economic Growth: A Cross-Country Empirical Study 1997 Cambridge, MA MIT Press
Search in Google Scholar Back to article
Bodner T E What improves with increased missing data imputations? Structural Equation Modeling 2008 15 651 675 10.1080/10705510802339072
Open DOI Search in Google Scholar Back to article
Carpenter J R Kenward M G Multiple Imputation and its Application 2013 Chichester, West Sussex A John Wiley & Sons Publication
Search in Google Scholar Back to article
Carsey T M Harden J J Monte Carlo Simulation and Resampling Methods for Social Science 2014 Thousand Oaks, CA Sage Publications 10.4135/9781483319605
Open DOI Search in Google Scholar Back to article
Central Intelligence Agency The World Factbook 2016 Available at: https://www.cia.gov/library/publications/the-world-factbook/index.html [Last accessed November 27, 2016]
Search in Google Scholar Back to article
Cheema J R Some general guidelines for choosing missing data handling methods in educational research Journal of Modern Applied Statistical Methods 2014 13 2 53 75 10.22237/jmasm/1414814520
Open DOI Search in Google Scholar Back to article
Cranmer S J Gill J We have to be discrete about this: A non-parametric imputation technique for missing categorical data British Journal of Political Science 2013 43 2 425 449 10.1017/S0007123412000312
Open DOI Search in Google Scholar Back to article
Deng Y Chang C Ido M S Long Q Multiple imputation for general missing data patterns in the presence of high-dimensional data Scientific Reports 2016 6 21689 1 10 10.1038/srep21689
Open DOI Search in Google Scholar Back to article
de Waal T Pannekoek J Scholtus S Handbook of Statistical Data Editing and Imputation 2011 Hoboken, NJ John Wiley & Sons 10.1002/9780470904848
Open DOI Search in Google Scholar Back to article
Do B C Batzoglou S What is the expectation maximization algorithm? Nature Biotechnology 2008 26 8 897 899 10.1038/nbt1406
Open DOI Search in Google Scholar Back to article
Donders A R T van der Heijden G J M G Stijnen T Moons K G M Review: A gentle introduction to imputation of missing values Journal of Clinical Epidemiology 2006 59 1087 1091 10.1016/j.jclinepi.2006.01.014
Open DOI Search in Google Scholar Back to article
Enders C K Applied Missing Data Analysis 2010 New York, NY The Guilford Press
Search in Google Scholar Back to article
Feng Y Democracy, Governance, and Economic Performance: Theory and Evidence 2003 Cambridge, MA The MIT Press
Search in Google Scholar Back to article
Freedom House Freedom in the World 2016 2016 Available at: https://freedomhouse.org/report/freedom-world/freedom-world-2016 [Last accessed November 30, 2016]
Search in Google Scholar Back to article
Gill J Bayesian Methods: A Social and Behavioral Sciences Approach 2008 Second Edition London Chapman & Hall/CRC
Search in Google Scholar Back to article
Graham J W Missing data analysis: Making it work in the real world Annual Review of Psychology 2009 60 549 576 10.1146/annurev.psych.58.110405.085530
Open DOI Search in Google Scholar Back to article
Graham J W Olchowski A E Gilreath T D How many imputations are really needed? Some practical clarifications of multiple imputation theory Prevention Science 2007 8 3 206 213 10.1007/s11121-007-0070-9
Open DOI Search in Google Scholar Back to article
Gujarati D N Basic Econometrics 2003 Fourth Edition Boston, MA McGraw-Hill
Search in Google Scholar Back to article
Hardt J Herke M Leonhart R Auxiliary variables in multiple imputation in regression with missing X: A warning against including too many in small sample research BMC Medical Research Methodology 2012 12 184 1 13 10.1186/1471-2288-12-184
Open DOI Search in Google Scholar Back to article
Honaker J King G What to do about missing values in time series cross-section data American Journal of Political Science 2010 54 2 561 581 10.1111/j.1540-5907.2010.00447.x
Open DOI Search in Google Scholar Back to article
Honaker J King G Blackwell M Amelia II: A program for missing data Journal of Statistical Software 2011 45 7 1 47 10.18637/jss.v045.i07
Open DOI Search in Google Scholar Back to article
Honaker J King G Blackwell M Package ‘Amelia’ 2016 Available at: http://cran.r-project.org/web/packages/Amelia/Amelia.pdf [Last accessed November 30, 2016]
Search in Google Scholar Back to article
Horowitz J L Heckman J J Leamer E The bootstrap Handbook of Econometrics 2001 North Holland Elsevier 5 10.1016/s1573-4412(01)05005-x
Open DOI Search in Google Scholar Back to article
Horton N J Kleinman K P Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models The American Statistician 2007 61 1 79 90 10.1198/000313007X172556
Open DOI Search in Google Scholar Back to article
Horton N J Lipsitz S R Multiple imputation in practice: Comparison of software packages for regression models with missing variables The American Statistician 2001 55 3 244 254 10.1198/000313007X172556
Open DOI Search in Google Scholar Back to article
Hughes R A Sterne J A C Tilling K Comparison of imputation variance estimators Statistical Methods in Medical Research 2016 25 6 2541 2557 10.1177/0962280214526216
Open DOI Search in Google Scholar Back to article
King G Honaker J Joseph A Scheve K Analyzing incomplete political science data: An alternative algorithm for multiple imputation American Political Science Review 2001 95 1 49 69
Search in Google Scholar Back to article
Kropko J Goodrich B Gelman A Hill J Multiple imputation for continuous and categorical data: Comparing joint multivariate normal and conditional approaches Political Analysis 2014 22 4 497 519 10.1093/pan/mpu007
Open DOI Search in Google Scholar Back to article
Lee K J Carlin J B Multiple imputation for missing data: Fully conditional specification versus multivariate normal imputation American Journal of Epidemiology 2010 171 5 624 632 10.1093/aje/kwp425
Open DOI Search in Google Scholar Back to article
Lee K J Carlin J B Recovery of information from multiple imputation: A simulation study Emerging Themes in Epidemiology 2012 9 3 1 10 10.1186/1742-7622-9-3
Open DOI Search in Google Scholar Back to article
Leite W Beretvas S The performance of multiple imputation for Likert-type items with missing data Journal of Modern Applied Statistical Methods 2010 9 1 64 74 10.22237/jmasm/1272686820
Open DOI Search in Google Scholar Back to article
Li F Yu Y Rubin D B Imputing missing data by fully conditional models: Some cautionary examples and guidelines Duke University Department of Statistical Science Discussion Paper 2012 11 14 1 35
Search in Google Scholar Back to article
Little R J A Rubin D B Statistical Analysis with Missing Data 2002 Second Edition Hoboken, NJ John Wiley & Sons 10.1002/9781119013563
Open DOI Search in Google Scholar Back to article
McNeish D Missing data methods for arbitrary missingness with small samples Journal of Applied Statistics 2017 44 1 24 39 10.1080/02664763.2016.1158246
Open DOI Search in Google Scholar Back to article
Mooney C Z Monte Carlo Simulation 1997 Thousand Oaks, CA Sage Publications 10.4135/9781412985116
Open DOI Search in Google Scholar Back to article
Raghunathan T Missing Data Analysis in Practice 2016 Boca Raton, FL CRC Press
Search in Google Scholar Back to article
Rubin D B Multiple Imputation for Nonresponse in Surveys 1987 New York, NY John Wiley & Sons 10.1002/9780470316696
Open DOI Search in Google Scholar Back to article
Schafer J L Analysis of Incomplete Multivariate Data 1997 Boca Raton, FL Chapman & Hall/CRC 10.1201/9781439821862
Open DOI Search in Google Scholar Back to article
Schafer J L Package ‘norm2’ 2016 Available at: https://cran.r-project.org/web/packages/norm2/norm2.pdf [Last accessed November 30, 2016]
Search in Google Scholar Back to article
Schafer J L Graham J W Missing data: Our view of the state of the art Psychological Methods 2002 7 2 147 177 10.1037//1082-989X.7.2.147
Open DOI Search in Google Scholar Back to article
Schafer J L Olsen M K Multiple imputation for multivariate missing-data problems: A data analyst’s perspective Multivariate Behavioral Research 1998 33 545 571 10.1207/s15327906mbr3304_5
Open DOI Search in Google Scholar Back to article
Schenker N Raghunathan T E Chiu P-L Makuc D M Zhang G Cohen A J Multiple imputation of missing income data in the national health interview survey Journal of the American Statistical Association 2006 101 475 924 933 10.1198/016214505000001375
Open DOI Search in Google Scholar Back to article
Scheuren F Multiple imputation: How it began and continues The American Statistician 2005 59 4 315 319 10.1198/000313005X74016
Open DOI Search in Google Scholar Back to article
Shara N Yassin S A Valaitis E Wang H Howard B V Wang W Lee E T Umans J G Randomly and non-randomly missing renal function data in the strong heart study: A comparison of imputation methods PLOS ONE 2015 10 9 1 11 10.1371/journal.pone.0138923
Open DOI Search in Google Scholar Back to article
Stuart E A Azur M Frangakis C Leaf P Multiple imputation with large data sets: A case study of the children’s mental health initiative American Journal of Epidemiology 2009 169 9 1133 1139 10.1093/aje/kwp026
Open DOI Search in Google Scholar Back to article
Takahashi M Multiple ratio imputation by the EMB algorithm: Theory and simulation Journal of Modern Applied Statistical Methods 2017a 16 1 630 656 10.22237/jmasm/1493598840
Open DOI Search in Google Scholar Back to article
Takahashi M Implementing multiple ratio imputation by the EMB algorithm (R) Journal of Modern Applied Statistical Methods 2017b 16 1 657 673 10.22237/jmasm/1493598900
Open DOI Search in Google Scholar Back to article
Takahashi M Ito T “Multiple imputation of missing values in economic surveys: Comparison of competing algorithms,” Proceedings of The 59th World Statistics Congress of the International Statistical Institute (ISI) 2013 Hong Kong, China 3240 3245
Search in Google Scholar Back to article
Takahashi M Ito T Comparison of competing algorithms of multiple imputation: Analysis using large-scale economic data Research Memoir of Official Statistics 2014 71 39 82
Search in Google Scholar Back to article
Takahashi M Iwasaki M Tsubaki H Imputing the mean of a heteroskedastic log-normal missing variable: A unified approach to ratio imputation Statistical Journal of the IAOS 2017 33 3 10.3233/SJI-160306 in press
Open DOI Search in Google Scholar Back to article
van Buuren S Flexible Imputation of Missing Data 2012 Boca Raton, FL Chapman & Hall/CRC 10.1201/b11826
Open DOI Search in Google Scholar Back to article
van Buuren S Groothuis-Oudshoorn K mice: multivariate imputation by chained equations in R Journal of Statistical Software 2011 45 3 1 67 10.18637/jss.v045.i03
Open DOI Search in Google Scholar Back to article
van Buuren S Groothuis-Oudshoorn K Roxitzsch A Vink G Doove L Jolani S Package ‘mice’ 2015 Available at: https://cran.r-project.org/web/packages/mice/mice.pdf [Last accessed November 30, 2016]
Search in Google Scholar Back to article
von Hippel P T New confidence intervals and bias comparisons show that maximum likelihood can beat multiple imputation in small samples Structural Equation Modeling 2016 23 3 422 437 10.1080/10705511.2015.1047931
Open DOI Search in Google Scholar Back to article
Zhu J Raghunathan T E Convergence properties of a sequential regression multiple imputation algorithm Journal of the American Statistical Association 2015 110 511 1112 1124 10.1080/01621459.2014.948117
Open DOI Search in Google Scholar Back to article