Exact unbiased covariance estimation for modified least-squares regression with binary outcomes
By: Takahiro Kitano and Hisashi Noma
References
- Altman D.G., Deeks J.J., Sackett D.L. (1998): Odds Ratios Should Be Avoided When Events Are Common. BMJ 317(7168): 1318.
- Bera A.K., Suprayitno T., Premaratne G. (2002): On Some Heteroskedasticity-Robust Estimators of Variance-Covariance Matrix of the Least-Squares Estimators. Journal of Statistical Planning and Inference 108(1-2): 121-136.
- Chesher A., Austin G. (1991): The Finite-Sample Distributions of Heteroskedasticity Robust Wald Statistics. Journal of Econometrics 47(1): 153-173.
- Chesher A., Jewitt I. (1987): The Bias of a Heteroskedasticity Consistent Covariance Matrix Estimator. Econometrica 55(5): 1217-1222.
- Cheung Y. B. (2007): A Modified Least-Squares Regression Approach to the Estimation of Risk Difference. American Journal of Epidemiology 166(11): 1337-1344.
- Cribari-Neto F. (2004): Asymptotic Inference under Heteroskedasticity of Unknown Form. Computational Statistics & Data Analysis 45(2): 215-233.
- Cribari-Neto F., Souza T.C., Vasconcellos K.L.P. (2007): Inference under Heteroskedasticity and Leveraged Data. Communications in Statistics—Theory and Methods 36(10): 1877-1888.
- Davis C.S. (1991): Semi-Parametric and Non-Parametric Methods for the Analysis of Repeated Measurements with Applications to Clinical Trials. Statistics in Medicine 10(12): 1959-1980.
- Dobriban E., Su W.J., Yang Y., Zhang Z. (2018): Robust Inference under Heteroskedasticity Via the Hadamard Estimator. arXiv: 1807.00347.
- Eicker F. (1963): Asymptotic Normality and Consistency of the Least Squares Estimators for Families of Linear Regressions. Annals of Mathematical Statistics 34(2): 447–456.
- Eicker F. (1967). Limit Theorems for Regressions with Unequal and Dependent Errors. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, L. M. Le Cam, and J. Neyman (eds), 59-82. Berkeley: University of California Press.
- Fay M.P., Graubard B.I. (2001): Small-Sample Adjustments for Wald-Type Tests Using Sandwich Estimators. Biometrics 57(4): 1198-1206.
- Godambe V.P., Heyde C.C. (1987): Quasi-Likelihood and Optimal Estimation. International Statistical Review 55(3): 231-244.
- Gosho M., Sato Y., Takeuchi H. (2014): Robust Covariance Estimator for Small-Sample Adjustment in the Generalized Estimating Equations: A Simulation Study. Science Journal of Applied Mathematics and Statistics 2(1): 20-25.
- Halekoh U., Højsgaard S., Yan J. (2006): The R Package Geepack for Generalized Estimating Equations. Journal of Statistical Software 15(2): 1-11.
- Hartley H.O., Rao J.N.K., Kiefer G. (1969): Variance Estimation with One Unit Per Stratum. Journal of the American Statistical Association 64(327): 841-851.
- Hinkley D.V. (1977): Jackknifing in Unbalanced Situations. Technometrics 19(3): 285-292.
- Hopewell S., Chan A.W., Collins G.S., Hrobjartsson A., Moher D., Schulz K.F., Tunn R., Aggarwal R., Berkwits M., Berlin J.A., Bhandari N., Butcher N.J., Campbell M.K., Chidebe R.C.W., Elbourne D., Farmer A., Fergusson D.A., Golub R.M., Goodman S.N., Hoffmann T.C., Ioannidis J.P.A., Kahan B.C., Knowles R.L., Lamb S.E., Lewis S., Loder E., Offringa M., Ravaud P., Richards D.P., Rockhold F.W., Schriger D.L., Siegfried N.L., Staniszewska S., Taylor R.S., Thabane L., Torgerson D., Vohra S., White I.R., Boutron I. (2025): CONSORT 2025 Statement: Updated Guideline for Reporting Randomized Trials. Nature Medicine. 31(6):1776-1783.
- Huber P.J. (1967). The Behavior of Maximum Likelihood Estimates under Nonstandard Conditions. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, L. Le Cam, and J. Neyman (eds), 221–233. Berkeley: University of California Press.
- Long J.S., Ervin L.H. (2000): Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model. American Statistician 54(3): 217-224.
- MacKinnon J.G., White H. (1985): Some Heteroskedasticity-Consistent Covariance Matrix Estimators with Improved Finite Sample Properties. Journal of Econometrics 29(3): 305-325.
- Mancl L.A., DeRouen T.A. (2001): A Covariance Estimator for GEE with Improved Small-Sample Properties. Biometrics 57(1): 126-134.
- McNutt L.A., Wu C., Xue X., Hafner J.P. (2003): Estimating the Relative Risk in Cohort Studies and Clinical Trials of Common Outcomes. American Journal of Epidemiology 157(10): 940-943.
- Morel J.G., Bokossa M., Neerchal N. (2003): Small Sample Correction for the Variance of GEE Estimators. Biometrical Journal 45(4): 395-409.
- Nelder J.A., Wedderburn R.W.M. (1972): Generalized Linear Models. Journal of the Royal Statistical Society, Series A 135(3): 370-384.
- Noma H., Gosho M. (2025): Finite-Sample Improved Confidence Intervals Based on the Estimating Equation Theory for the Modified Poisson and Least-Squares Regressions. Epidemiologic Methods 14(1): 20240030.
- Noma H., Sunada H., Gosho M. (2025): Quasi-Likelihood Ratio Tests and the Bartlett-Type Correction for Improved Inferences of the Modified Poisson and Least-Squares Regressions for Binary Outcomes. Statistica Neerlandica 79(3): e70012.
- Nurminen M. (1995): To Use or Not to Use the Odds Ratio in Epidemiologic Analyses. European Journal of Epidemiology 11(4): 365-371.
- Pan W., Wall M.M. (2002): Small-Sample Adjustments in Using the Sandwich Variance Estimator in Generalized Estimating Equations. Statistics in Medicine 21(10): 1429-1441.
- Rao C.R. (1970): Estimation of Heteroscedastic Variances in Linear Models. Journal of the American Statistical Association 65: 161-172.
- Rothman K.J., Greenland S., Lash T.L. (2008). Modern Epidemiology, 3rd edition. Lippincott Williams & Wilkins, Philadelphia.
- Thompson J., Watson S.I., Middleton L., Hemming K. (2025): Estimating Relative Risks and Risk Differences in Randomised Controlled Trials: A Systematic Review of Current Practice. Trials 26(1): 1.
- Uno S., Noma H., Gosho M. (2024): Firth-Type Penalized Methods of the Modified Poisson and Least-Squares Regression Analyses for Binary Outcomes. Biometrical Journal 66(7): e202400004.
- Wallenstein S., Bodian C. (1987): Epidemiologic Programs for Computers and Calculators. Inferences on Odds Ratios, Relative Risks, and Risk Differences Based on Standard Regression Programs. American Journal of Epidemiology 126(2): 346-355.
- Wang M., Long Q. (2011): Modified Robust Variance Estimator for Generalized Estimating Equations with Improved Small-Sample Performance. Statistics in Medicine 30(11): 1278-1291.
- Wedderburn R.W.M. (1974): Quasi-Likelihood Functions, Generalized Linear Models, and the Gauss–Newton Method. Biometrika 61(3): 439-447.
- White H. (1980): A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity. Econometrica 48(4): 817-838.
- Xu Y., Cheung Y.B., Lam K.F., Tan S.H., Milligan P. (2010): A Simple Approach to the Estimation of Incidence Rate Difference. American Journal of Epidemiology 172(3): 334-343.
DOI: https://doi.org/10.2478/bile-2026-0012 | Journal eISSN: 2199-577X (formerly 1896-3811) | Journal ISSN: 1896-3811
Language: English
Published on: Nov 10, 2026
Published by: Polish Biometric Society
In partnership with: Paradigm Publishing Services
Keywords:
Related subjects:
© 2026 Takahiro Kitano, Hisashi Noma, published by Polish Biometric Society
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.