Have a personal or library account? Click to login

Survey Nonresponse Trends and Fieldwork Effort in the 21st Century: Results of an International Study across Countries and Surveys

Open Access
|Jul 2020

References

  1. AAPOR (American Association of Public Opinion Research) Task Force on Survey Refusals. 2014. Current Knowledge and Considerations Regarding Survey Refusals. Available at: http://www.aapor.org/AAPOR_Main/media/MainSiteFiles/RefusalTF_FINAL090814.pdf (accessed 20 January 2020).
  2. AAPOR: American Association of Public Opinion Research. 2016. Standard Definitions, Final Dispositions of Case Codes and Outcome Rates for Surveys. Available at: https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf (accessed 28 April 2020).
  3. Atrostic, B.K., N. Bates, G. Burt, and A. Silberstein. 2001. “Nonresponse in US Government Household Surveys: Consistent Measures, Recent Trends, and New Insights.” Journal of Official Statistics 17: 209–226. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/nonresponse-in-u.s.-government-household-surveys-consistent-measures-recent-trends-and-new-insights.pdf (accessed 28 April 2020).
  4. Bethlehem, J., F. Cobben, and B. Schouten. 2011. Handbook of Nonresponse in Household Surveys. New York: Wiley. DOI: https://doi.org/10.1002/9780470891056.10.1002/9780470891056
  5. Beullens, K., G. Loosveldt, C. Vandenplas, and I. Stoop. 2018. “Response Rates in The European Social Survey: Increasing, Decreasing, or a Matter of Fieldwork Efforts?” Survey Methods: Insights from the Field. DOI: https://doi.org/10.13094/SMIF-2018-00003.
  6. Biemer, P.P. and L.E. Lyberg. 2003. Introduction to Survey Quality. New York: Wiley. DOI: https://doi.org/10.1002/0471458740.10.1002/0471458740
  7. Bradburn, N. 1992. “A Response to the Nonresponse Problem: Presidential Address AAPOR.” Public Opinion Quarterly 56: 391–387. DOI: https://doi.org/10.1093/poq/56.3.391.10.1093/poq/56.3.391
  8. Brehm, J. 1993. The Phantom Respondents: Opinion Surveys and Political Representation. Ann Arbor: The University of Michigan Press. DOI: https://doi.org/10.3998/mpub.9690285.10.3998/mpub.9690285
  9. Brick, J.M. 2013. “Unit Nonresponse and Weighting Adjustments: A Critical Review.” Journal of Official Statistics 29: 329–352. DOI: https://doi.org/10.2478/jos-2013-0026.10.2478/jos-2013-0026
  10. Chun, A.Y., S.G. Heeringa, and B. Schouten. 2018. “Responsive and Adaptive Design for Survey Optimization.” Journal of Official Statistics 34: 581–597. DOI: https://doi.org/10.2478/jos-2018-0028.10.2478/jos-2018-0028
  11. Curtin, R., S. Presser, and E. Singer. 2005. “Changes in Telephone Survey Nonresponse Over the Past Quarter Century.” Public Opinion Quarterly 69: 87–98. DOI: https://doi.org/10.1093/poq/nfi002.10.1093/poq/nfi002
  12. De Heer, W. 1999. “International Response Trends: Results of An International Survey.” Journal of Official Statistics 15: 129–142. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/international-response-trends-results-ofan-international-survey.pdf (accessed 14 February 2020).
  13. De Leeuw, E.D. 2018. “Mixed-Mode: Past, Present, and Future”. Survey Research Methods, 17: 75–89. Available at: https://ojs.ub.uni-konstanz.de/srm/article/view/7402/6582 (accessed 20 January 2020).
  14. De Leeuw, E., and W. De Heer. 2002. “Trends in Household Survey Nonresponse: A Longitudinal and International Comparison.” In Survey Nonresponse, Edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, R.J.A. Little, 41–54. New York: Wiley.
  15. De Leeuw, E., J. Hox, and A. Luiten. 2018. “International Nonresponse Trends Across Countries and Years: An Analysis of 36 Years of Labor Force Survey Data.” Survey Methods: Insights from the Field. Available at: https://surveyinsights.org/?p=10452 (accessed 28 April 2020).
  16. De Leeuw, E., J. Hox, H. Silber, B. Struminskaya, and C. Vis. 2019. “Development of An International Survey Attitude Scale: Measurement Equivalance, Reliability, and Predictive Validity.” Measurement Instruments for the Social Sciences,1:9. DOI: https://doi.org/10.1186/s42409-019-0012-x.10.1186/s42409-019-0012-x
  17. Dillman, D.A. 2017. “The Promise and Challenges of Pushing Respondents to the Web in Mixed-Mode Surveys.” Survey Methodology. Statistics Canada, Catalogue No. 12–001–X, Vol. 43, No. 1. Available at: http://www.statcan.gc.ca/pub/12-001-x/2017001/article/14836-eng.htm (accessed 5 May 2020).
  18. Dillman, D.A. 1978. Mail and Telephone Surveys; the Total Design Method. New York: Wiley.
  19. Dillman, D.A., J. L. Eltinge, R.M. Groves, and R.J.A. Little. 2002. “Survey nonresponse in design, data collection, and analysis”. In Survey Nonresponse, Edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J.A. Little: 3–26. New York: Wiley.
  20. Dillman, D.A., J.D. Smyth, and L.M. Christian. 2014. Internet, Phone, Mail, and Mixed-Mode Surveys. The Tailored Design Method, Fourth Edition. New York: Wiley.
  21. Dutwin D. and P.J. Lavrakas. 2017. Trends in Telephone Outcomes, Appendix D to the Future of US General Population Telephone Survey Research AAPOR Task Force Report 2017. Available at: https://www.aapor.org/Education-Resources/Reports/The-Future-Of-U-S-General-Population-Telephone-Sur.aspx?utm_source=link_news-v9&utm_campaign_item_225143&utm_medium=copy (accessed 14 February 2020).
  22. Groves, R. 1989. Survey Errors and Survey Costs. New York: Wiley. DOI: https://doi.org/10.1002/0471725277.10.1002/0471725277
  23. Groves, R.M. and M.P. Couper. 1998. Nonresponse in Household Survey Interviews. New York: Wiley. DOI: https://doi.org/10.1002/9781118490082.10.1002/9781118490082
  24. Groves, R.M., F.J. Fowler, M.P. Couper, J.M. Lepkowski, E. Singer, and R. Tourangeau. 2004. Survey Methodology, Second Edition. New York: Wiley.
  25. Guilford, J.P. and B. Fruchter. 1978. Fundamental Statistics in Psychology and Education. New York, London: McGraw-Hill.
  26. Harris-Kojetin, B.A. and C. Tucker. 1999. “Exploring the Relations of Economic and Political Conditions With Refusal Rates to a Government Survey.” Journal of Official Statistics 15: 167–184. Available at: https://www.scb.se/contentassets/ca21efb41-fee47d293bbee5bf7be7fb3/exploring-the-relation-of-economic-and-political-conditions-with-refusal-rates-to-a-government-survey.pdf (accessed 14 April 2020).
  27. Hox, J.J. and E.D. De Leeuw. 1994. “A Comparison of Nonresponse in Mail, Telephone, and Face-to-face Surveys; Applying Multilevel Models to Meta-Analysis.” Quality and Quantity 28: 329-344. DOI: https://doi.org/10.1007/BF01097014.10.1007/BF01097014
  28. Hox, J., M. Moerbeek, and R. Van De Schoot. 2018. Multilevel Analysis. Techniques and Applications. New York, London: Routledge. DOI: https://doi.org/10.4324/9781315650982.10.4324/9781315650982
  29. Larsen, L.J, J. Fane Lineback, and B.M. Reist 2020 “Continuing to Explore the Relation between Economic and Political Factors and Government Survey Refusal Rates: 1960–2015”. Journal of Official Statistics, this issue.10.2478/jos-2020-0026
  30. Lavrakas, P.J., M.W. Traugott, C. Kennedy, A.L. Holbrook, E.D. De Leeuw, and B.T. West. 2019. Experimental Methods in Survey Research. Techniques That Combine Random Sampling With Random Assignment. New York: Wiley. DOI: https://doi.org/10.1002/9781119083771.10.1002/9781119083771
  31. Loosveldt, G. 2019. Valedictory Address. Leuven: KU Leuven, November 15, 2019. Available at: https://soc.kuleuven.be/fsw/nieuws/emeritaat-geert-loosveldt (accessed June 2020).
  32. Loosveldt, G. and D. Joye. 2016. “Defining and Assessing Survey Climate.” In The Sage Handbook of Survey Methodology, Edited by C. Wolf, D. Joye, T.W. Smith, and Y-C Fu, 67-76. Los Angeles: Sage. DOI: https://doi.org/10.4135/9781473957893.n27.10.4135/9781473957893.n27
  33. Luiten, A., E. de Leeuw, B. Schouten, and J. Hox. 2016. “First Results of the (new) International Questionnaire on Nonresponse: Response of the LFS.” Paper Presented at International Workshop of Household Survey Nonresponse, Oslo, Norway, 31-8/1-9, 2016. Available at: https://www.nonresponse.org/uploadi/editor/DnD148714714898539LuiteneaInternationalQuestionnaire.docx (accessed June 2020).
  34. Marken, S. 2018. Still Listening: The State of Telephone Surveys. Gallup. Available at: https://news.gallup.com/opinion/methodology/225143/listening-state-telephone-surveys.aspx (accessed 14 July 2019).
  35. Muthén, L.K. and B.O. Muthén. 2017. Mplus User’s Guide. Eight Edition. Los Angeles, CA: Muthén & Muthén.
  36. Pew Research. 2012. Assessing the Representativeness of Public Opinion Surveys. Available at: https://www.people-press.org/2012/05/15/assessing-the-representativeness-of-public-opinion-surveys/ (accessed 28 April 2020).
  37. Schouten, B., N. Shlomo, and C. Skinner. 2011. “Indicators for Monitoring and Improving Representativeness of Response.” Journal of Official Statistics. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/indicators-for-monitoring-and-improving-representativeness-of-response.pdf (accessed 28 April 2020).
  38. Singer, E. 2002. “The Use of Incentives to Reduce Nonresponse in Household Surveys.” In Survey Nonresponse, Edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J.A. Little, 163–178. New York: Wiley.
  39. Singer, E. and C. Ye. 2013. “The Use and Effects of Incentives in Surveys”. The Annals of the American Academy of Political and Social Science 645: 112–141. DOI: https://doi.org/10.1177/0002716212458082.10.1177/0002716212458082
  40. Steeh, C. 1981. “Trends in Nonresponse Rates, 1952-1979.” Public Opinion Quarterly 45: 40–57. DOI: https://doi.org/10.1086/268633.10.1086/268633
  41. Stoop, I. 2005. The Hunt for the Last Respondent. The Hague: Social and Cultural Planning Office. Available at: https://www.scp.nl/english/Publications/Publications_-by_year/Publications_2005/The_Hunt_for_the_Last_Respondent (accessed 14 February 2020).
  42. Stoop, I. 2016. “Unit Nonresponse“. In The Sage Handbook of Survey Methodology, Edited by C. Wolf, D. Joye, T.W. Smith, and Y-C Fu, 409-424. Los Angeles: Sage. DOI: https://doi.org/10.4135/9781473957893.n27.10.4135/9781473957893.n27
  43. Stoop, I., J. Billiet, A. Koch, and R. Fitzgerald. 2010. Improving Survey Response: Lessons Learned from the European Social Survey. Chichester: Wiley. DOI: https://doi.org/10.1002/9780470688335.10.1002/9780470688335
  44. Tabachnick, B.G., and L. Fidell. 2013. Using Multivariate Statistics. Boston, MA: Pearson.
  45. Tourangeau, R., J.M. Brick, S. Lohr, and J. Li. 2016. “Adaptive and Responsive Survey Designs: A Review and Assessment.” Journal of the Royal Statistical Society, Series A. 180: 203 223. DOI: https://doi.org/10.1111/rssa.12186.10.1111/rssa.12186
  46. Vehovar, V. 1999. “Field Substitution and Unit Nonresponse”. Journal of Official Statistics, 15: 333–550. Available at: https://www.scb.se/contentassets/ca21efb41-fee47d293bbee5bf7be7fb3/field-substitution-and-unit-nonresponse.pdf (accessed 28 April 2020).
  47. Williams, D. and J.M. Brick. 2018. “Trends in US Face-to-Face Household Survey Nonresponse and Level of Effort”. Journal of Survey Statistics and Methodology 6: 186–211. DOI: https://doi.org/10.1093/jssam/smx019.10.1093/jssam/smx019
Language: English
Page range: 469 - 487
Submitted on: Aug 1, 2019
Accepted on: May 1, 2020
Published on: Jul 24, 2020
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 4 times per year

© 2020 Annemieke Luiten, Joop Hox, Edith de Leeuw, published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.