A Distance Metric for Modeling the Quality of Administrative Records for Use in the 2020 U.S. Census

Andrew Keller; Vincent T. Mule; Darcy Steeg Morris; Scott Konicki

doi:10.2478/jos-2018-0029

Abstract

The U.S. Census Bureau is conducting research on using administrative records to reduce the cost while maintaining the quality of the 2020 Census Nonresponse Followup (NRFU). Previous census tests have implemented approaches that use predictive models and optimization procedures to identify vacant and occupied housing units using administrative records. This article details a modification to previous approaches, introducing a simple distance metric to define a quality ranking of housing units to enumerate using administrative records. The distance approach is illustrated, assessed, and compared to a previous approach via a retrospective study of the 2010 U.S. Census.

References

Alvey, W. and F. Scheuren. 1982. “Background for an Administrative Record Census.” in JSM Proceedings, Social Statistics Section, American Statistical Association, Cincinnati, OH, August 16–19, 1982. Washington, DC: American Statistical Association. 137–152.
Search in Google Scholar Back to article
Bakker, B.F.M., P.G.M. van Heijden, and S. Scholtus. 2015. “ “Preface” to a Special Issue on Coverage Problems in Administrative Sources.” Journal of Official Statistics 31(3): 349–355. Doi: http://dx.doi.org/10.1515/jos-2015-0021.10.1515/jos-2015-0021
Open DOI Search in Google Scholar Back to article
Brackstone, G.J. 1987. “Issues in the Use of Administrative Records for Statistical Purposes.” Survey Methodology 13(1): 29–43. Available at: http://www.statcan.gc.ca/pub/12-001-x/1987001/article/14467-eng.pdf (accessed November 2017).
Search in Google Scholar Back to article
Chapin, M. and A. Keller. 2017. “Administrative Records Research and Planning, 2018 End-to-End Census Test: Nonresponse Followup.” from 2020 Census Program Management Review–April 21, 2017. Available at: https://www2.census.gov/programs-surveys/decennial/2020/program-management/pmr-materials/04-21-2017/pmr-update-testing-2017-04-21.pdf (accessed November 2017).
Search in Google Scholar Back to article
Chesnut, J. 2013. “Model-Based Mode Switching from Internet to Mail in the American Community Survey.” DSSD 2013 American Community Survey Memorandum Series #ACS13-MP-01. Available at: https://census.gov/content/dam/Census/library/working-papers/2013/acs/2013_Chesnut_01.pdf (accessed November 2017).
Search in Google Scholar Back to article
Chow, M.C., H.P. Janicki, M.J. Kutzbach, L.F. Warren, and M. Yi. 2017. “A Comparison of Training Modules for Administrative Records Use in Nonresponse Followup Operations: The 2010 Census and the American Community Survey.” Center for Economic Studies Working Paper #CES 17-47. Washington, DC: U.S. Census Bureau. Available at: https://www2.census.gov/ces/wp/2017/CES-WP-17-47.pdf (accessed November 2017).
Search in Google Scholar Back to article
Cresce, A. 2012. “Evaluation of Gross Vacancy Rates From the 2010 Census Versus Current Surveys: Early Findings from Comparisons with the 2010 Census and the 2010 ACS 1-Year Estimates.” Federal Committee on Statistical Methodology 2012 Research Conference, Washington, DC, January 10–12, 2012. Available at: https://www.census.gov/housing/files/FCSM%20paper.pdf (accessed November 2017).
Search in Google Scholar Back to article
Ennis, S.R., S.R. Porter, J.M. Noon, and E. Zapata. 2015. “When Race and Hispanic Origin Reporting are Discrepant Across Administrative Records and Third Party Sources: Exploring Methods to Assign Responses.” Center for Administrative Records Research and Applications Working Paper #2015-08. Washington, DC: U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2015/adrm/carra-wp-2015-08.pdf (accessed November 2017).10.31235/osf.io/5xhh6
Search in Google Scholar Back to article
Federal Committee of Statistical Methodology. 1980. “Report on Statistical Uses of Administrative Records.” Working Paper 6, Washington, DC. Available at: https://s3.amazonaws.com/sitesusa/wp-content/uploads/sites/242/2014/05/spwp6.pdf (accessed November 2017).
Search in Google Scholar Back to article
Fienberg, S.E. 2015. “Discussion” of a Special Issue on Coverage Problems in Administrative Sources. Journal of Official Statistics 31(3): 527–535. Doi: http://dx.doi.org/10.1515/jos-2015-0032.10.1515/jos-2015-0032
Open DOI Search in Google Scholar Back to article
Groves, R.M. and B.A. Harris-Kojetin (editors), National Academies of Sciences, Engineering, and Medicine (2017). Innovations in Federal Statistics: Combining Data Sources While Protecting Privacy. Washington DC: The National Academies Press.10.17226/2465228426187
Search in Google Scholar Back to article
Japec, L., F. Kreuter, M. Berg, P. Biemer, P., Decker, C. Lampe, J. Lane, C. O’Neil, and A. Usher. 2015. “AAPOR Report on Big Data: Report of the AAPOR Big Data Task Force.” Available at: http://www.aapor.org/AAPOR_Main/media/Task-Force-Reports/BigDataTaskForceReport_FINAL_2_12_15_b.pdf (accessed November 2017).
Search in Google Scholar Back to article
Keller, A. 2016. “Imputation Research for the 2020 Census.” Statistical Journal of the International Association of Official Statistics 32: 189–198. Doi: http://dx.doi.org/10.3233/SJI-161009.10.3233/SJI-161009
Open DOI Search in Google Scholar Back to article
Keller, A., T. Fox, and V.T. Mule. 2016. “2014 Census Test – Analysis of Administrative Record Usage.” U.S. Census Bureau. Available at: https://www2.census.gov/programs-surveys/decennial/2020/program-management/final-analysis-reports/2020-analysis-2014-census-test-ad-rec.pdf (accessed November 2017).
Search in Google Scholar Back to article
Keller, A. and S. Konicki. 2016. “Using 2010 Census Coverage Measurement Results to Better Understand Possible Administrative Records Incorporation in the Decennial Census.” in JSM Proceedings, Survey Research Methods Section, American Statistical Association, Chicago, IL, July 30–August 4, 2016. Alexandria, VA: American Statistical Association. 701–710. Available at: https://ww2.amstat.org/sections/srms/Proceedings/y2016/files/389544.pdf (accessed November 2017).
Search in Google Scholar Back to article
Kingkade, W. 2013. “Self-assessed Housing Values in the American Community Survey: An Exploratory Evaluation Using Linked Real Estate Records.” in JSM Proceedings, Government Statistics Section, American Statistical Association, Montreal, Quebec, Canada, August 3-8, 2013. Alexandria, VA: American Statistical Association. 990–1004. Available at: https://ww2.amstat.org/MembersOnly/proceedings/2013/data/assets/handouts/308063_80215.pdf (accessed November 2017).
Search in Google Scholar Back to article
Layne, M., D. Wagner, and C. Rothhaas. 2014. “Estimating Record Linkage False Match Rate for the Person Identification Validation System.” Center for Administrative Records Research and Applications Working Paper #2014-02. Washington, DC: U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2014/adrm/carra-wp-2014-02.pdf (accessed November 2017).
Search in Google Scholar Back to article
Maris, M., E.S. Nordholt, and J. van Zeijl. 2012. “Comparing Approaches of Different (Partly) Register-based Countries.” from the United Nations Economic Commission for Europe Conference of European Statisticians: UNECE-Eurostat Expert Group Meeting on Censuses Using Registers. Available at: www.unece.org/fileadmin/DAM/stats/documents/ece/ces/ge.41/2012/use_of_register/WP_3_Netherlands.pdf (accessed November 2017).
Search in Google Scholar Back to article
Moore, B. 2015. “Preliminary Research for Replacing or Supplementing the Year Built Question on the American Community Survey with Administrative Records.” U.S. Census Bureau Working Paper. Available at: www.census.gov/library/working-papers/2015/acs/2015_Moore_02.html (accessed November 2017).
Search in Google Scholar Back to article
Morris, D.S. 2014. “A Comparison of Methodologies for Classification of Administrative Records Quality for Census numeration.” in JSM Proceedings, Survey Research Methods Section, American Statistical Association, Boston, MA, August 2–7, 2014. Alexandria, VA: American Statistical Association. 1729–1743. Available at: https://ww2.amstat.org/sections/srms/Proceedings/y2014/files/311864_88281.pdf (accessed November 2017).
Search in Google Scholar Back to article
Morris, D.S. 2017. “A Modeling Approach for Administrative Records Enumeration in the Decennial Census.” Public Opinion Quarterly: Special Issue on Survey Research, Today and Tomorrow 81(S1): 357–384. Doi: http://dx.doi.org/10.1093/poq/nfw059.10.1093/poq/nfw059
Open DOI Search in Google Scholar Back to article
Morris, D.S., A. Keller, and B. Clark. 2016. “An Approach for Using Administrative Records to Reduce Contacts in the 2020 Census.” Statistical Journal of the International Association of Official Statistics 32: 177–188. Doi: http://dx.doi.org/10.3233/SJI-161002.10.3233/SJI-161002
Open DOI Search in Google Scholar Back to article
Mule, V.T. and A. Keller. 2014. “Using Administrative Records to Reduce Nonresponse Followup Operations.” in JSM Proceedings, Survey Research Methods Section, American Statistical Association, Boston, MA, August 2–7, 2014. Alexandria, VA: American Statistical Association. 3601–3608. Available at: https://ww2.amstat.org/sections/srms/Proceedings/y2014/files/313148_90659.pdf (accessed November 2017).
Search in Google Scholar Back to article
Mule, T. and S. Konicki. 2012. “2010 Census Coverage Measurement Estimation Report: Summary of Estimates of Coverage for Housing Units.” DSSD 2010 Census Coverage Measurement Memorandum Series #2010-G-02. https://www.census.gov/coverage_measurement/pdfs/g02.pdf (accessed November 2017).
Search in Google Scholar Back to article
Mulry, M.H. 2014. “Measuring Undercounts for Hard-to-Survey Groups.” In Hard-to-Survey Populations (Chapter 3), edited by R. Tourangeau, N. Bates, B. Edwards, T. Johnson, and K. Wolter. Cambridge, England: Cambridge University Press. 37–57.10.1017/CBO9781139381635.005
Search in Google Scholar Back to article
O’Hara, A., A. Bee, and J. Mitchell. 2016. “Preliminary Research for Replacing or Supplementing the Income Question on the American Community Survey with Administrative Records.” U.S. Census Bureau Working Paper. Available at: www.census.gov/content/dam/Census/library/working-papers/2016/acs/2016_Ohara_01.pdf (accessed November 2017).
Search in Google Scholar Back to article
Rastogi, S. and A. O’Hara. 2012. “2010 Census Match Study Report.” 2010 Census Planning Memorandum Series. Available at: https://www.census.gov/2010census/pdf/2010_Census_Match_Study_Report.pdf (accessed November 2017).
Search in Google Scholar Back to article
Ruggles, P. 2015. “Review of Administrative Record Sources Relevant to the American Community Survey.” U.S. Census Bureau Working Paper. Available at: www.census.gov/library/working-papers/2015/acs/2015_Ruggles_01.html (accessed November 2017).
Search in Google Scholar Back to article
Scheuren, F. 1999. “Administrative Records and Census Taking.” Survey Methodology 25(2): 151–160. Available at: http://www.statcan.gc.ca/pub/12-001-x/1999002/article/4878-eng.pdf?contentType=application%2Fpdf (accessed November 2017).
Search in Google Scholar Back to article
Steffey, D.L. and N.M. Bradburn (editors), National Research Council. 1994. Counting People in the Information Age. Washington DC: The National Academies Press.
Search in Google Scholar Back to article
Stempowski, D. 2015. “Agility in Action: A Snapshot of Enhancements to the American Community Survey.” ACS Information Series Memorandum Number 2015-05. Available at: https://www.census.gov/content/dam/Census/programs-surveys/acs/operations-and-administration/2015-16-survey-enhancements/Agility%20in%20Action%20v2.0.pdf (accessed November 2017).
Search in Google Scholar Back to article
Thygesen, L. 2015. “The Use of Administrative Sources for Censuses: Merits and Challenges.” Statistical Journal of the IAOS 31(3): 381–389. Doi: http://dx.doi.org/10.3233/SJI-150909.10.3233/SJI-150909
Open DOI Search in Google Scholar Back to article
United Nations Economic Commission for Europe (UNECE). 2011. Using Administrative and Secondary Sources for Official Statistics: A Handbook of Principles and Practices. United Nations Publication. www.unece.org/fileadmin/DAM/stats/publications/Using_Administrative_Sources_Final_for_web.pdf (accessed November 2017).
Search in Google Scholar Back to article
United States Census Bureau. 2017a. 2020 Census Operational Plan: Version 3.0. Washington DC: Census Bureau. Available at: http://www2.census.gov/programs-surveys/decennial/2020/program-management/planning-docs/2020-oper-plan3.pdf (accessed November 2017).
Search in Google Scholar Back to article
United States Census Bureau. 2017b. “Administrative Records Modeling Update for the Census Scientific Advisory Committee.” Presented at the Census Scientific Advisory Committee Meeting–March, 30, 2017. Available at: https://www2.census.gov/cac/sac/meetings/2017-03/admin-records-modeling.pdf (accessed November 2017).
Search in Google Scholar Back to article
United States Office of Management and Budget. 2014. M-14-06: Guidance for Providing and Using Administrative Data for Statistical Purposes. Available at: https://obama-whitehouse.archives.gov/sites/default/files/omb/memoranda/2014/m-14-06.pdf (accessed November 2017).
Search in Google Scholar Back to article
van Zeijl, J. 2014. “From Traditional to Register-Based Censuses in the Netherlands.” from the National Academies of Science: International Conference on Census Methods. Available at: https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_088800.pdf (accessed November 2017).
Search in Google Scholar Back to article
Wagner, D. and M. Layne. 2014. “The Person Identification Validation System (PVS): Applying the Center for Administrative Records Research and Applications’ (CARRA) Record Linkage Software.” Center for Administrative Records Research and Applications Working Paper #2014-01. Washington, DC: U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2014/adrm/carra-wp-2014-01.pdf (accessed November 2017).
Search in Google Scholar Back to article
Walejko, G., A. Keller, G. Dusch, and P.V. Miller. 2014. “2020 Research and Testing: 2013 Census Test Assessment.” U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/programs-surveys/decennial/2020-census/2013_Census_Test_Assessment_Final.pdf (accessed November 2017).
Search in Google Scholar Back to article
Walker, S., S. Winder, G. Jackson, and S. Heimel. 2012. “2010 Census Nonresponse Followup Operations Assessment.” 2010 Census Planning Memoranda Series, No. 190, April 30, 2012. Available at: https://www.census.gov/2010census/pdf/2010_Census_NRFU_Operations_Assessment.pdf (accessed November 2017).
Search in Google Scholar Back to article
Wallgren, A. and B. Wallgren. 2007. Register-based Statistics: Administrative Data for Statistical Purposes. New York: John Wiley and Sons.10.1002/9780470061350
Search in Google Scholar Back to article

A Distance Metric for Modeling the Quality of Administrative Records for Use in the 2020 U.S. Census

Abstract

Paradigm

My account