Have a personal or library account? Click to login
Relationship Between Past Survey Burden and Response Probability to a New Survey in a Probability-Based Online Panel Cover

Relationship Between Past Survey Burden and Response Probability to a New Survey in a Probability-Based Online Panel

By: Haomiao Jin and  Arie Kapteyn  
Open Access
|Dec 2022

References

  1. Andrieu, C., A. Doucet, and R. Holenstein. 2010. “Particle Markov Chain Monte Carlo Methods.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72 (3): 269–342. DOI: https://doi.org/10.1111/j.1467-9868.2009.00736.x.
  2. Baker, R., S.J. Blumberg, J.M. Brick, M.P. Couper, M. Courtright, J.M. Dennis, D. Dillman, M.R. Frankel, and P.Garland. 2010. “AAPOR Report on Online Panels.” Public Opinion Quarterly 74 (4): 711–781. DOI: https://doi.org/10.1093/poq/nfq048.
  3. Bartolucci, F., A. Farcomeni, and F. Pennoni. 2019. Latent Markov Models for Longitudinal Data. Boca Raton, FL: Chapman and Hall/CRC.
  4. Blumenberg, C., A.M.B. Menezes, H. Gonçalves, M.C. Formoso Assunção, F.C. Wehrmeister, F.C. Barros, and A.J.D. Barros. 2019. “The Role of Questionnaire Length and Reminders Frequency on Response Rates to a Web-Based Epidemiologic Study: A Randomised Trial.” International Journal of Social Research Methodology 22 (6): 625–35. DOI: https://doi.org/10.1080/13645579.2019.1629755.
  5. Bradburn, N. 1978. “Respondent Burden.” In Proceedings of the Survey Research Methods Section of the American Statistical Association, 35: 35–40. Alexandria, VA: American Statistical Association. Available at: http://www.asasrms.org/Proceedings/y1978f.html (accessed August 2021).
  6. Broman, C.L., V.L. Hamilton, W.S. Hoffman, and R. Mavaddat. 1995. “Race, Gender, and the Response to Stress: Autoworkers’ Vulnerability to Long-Term Unemployment.” American Journal of Community Psychology 23 (6): 813–842. DOI: https://doi.org/10.1007/BF02507017.8638552
  7. Canales, S., P.A. Ganz, and C.A. Coscarelli. 1995. “Translation and Validation of a Quality of Life Instrument for Hispanic American Cancer Patients: Methodological Considerations.” Quality of Life Research 4 (1): 3–11. DOI: https://doi.org/10.1007/BF02507017.
  8. Chen, K., and D.B. Kandel. 1995. “The Natural History of Drug Use from Adolescence to the Mid-Thirties in a General Population Sample.” American Journal of Public Health 85 (1): 41–47. DOI: https://doi.org/10.2105/ajph.85.1.41.16152907832260
  9. Cheng, A., G. Zamarro, and B. Orriens. 2020. “Personality as a Predictor of Unit Nonresponse in an Internet Panel.” Sociological Methods & Research 49 (3): 672–698. DOI: 10.1177/0049124117747305.10.1177/0049124117747305
  10. Crawford, S.D., M.P. Couper, and M.J. Lamias. 2001. “Web Surveys: Perceptions of Burden.” Social Science Computer Review 19 (2): 146–162. DOI: https://doi.org/10.1177/089443930101900202.
  11. Deutskens, E., K. de Ruyter, M. Wetzels, and P. Oosterveld. 2004. “Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study.” Marketing Letters 15 (1): 21–36. DOI: https://doi.org/10.1023/B:MARK.0000021968.86465.00.
  12. De Valpine, P., Daniel Turek, Christopher J. Paciorek, Clifford Anderson-Bergman, Duncan Temple Lang, and Rastislav Bodik. 2017. “Programming with Models: Writing Statistical Algorithms for General Model Structures with NIMBLE.” Journal of Computational and Graphical Statistics 26 (2): 403–413. DOI: https://doi.org/10.1080/10618600.2016.1172487.
  13. Duffy, D., J. Goldberg, and D. Buchwald. 2006. “Using Mail to Reach Patients Seen at an Urban Health Care Facility.” Journal of Health Care for the Poor and Underserved 17 (3): 522–531. DOI: https://doi.org/10.1353/hpu.2006.0104.16960320
  14. Eisele, G., H. Vachon, G. Lafit, P. Kuppens, M. Houben, I. Myin-Germeys, and W. Viechtbauer. 2020. “The Effects of Sampling Frequency and Questionnaire Length on Perceived Burden, Compliance, and Careless Responding in Experience Sampling Data in a Student Population.” Assessment. DOI: https://doi.org/10.1177/1073191120957102.32909448
  15. Fan, W., and Z. Yan. 2010. “Factors Affecting Response Rates of the Web Survey: A Systematic Review.” Computers in Human Behavior 26 (2): 132–139. DOI: https://doi.org/10.1016/j.chb.2009.10.015.
  16. Fu, Y. 2013. “On the Nature of Extraversion: Variation in Conditioned Contextual Activation of Dopamine-Facilitated Affective, Cognitive, and Motor Processes.” Frontiers in Human Neuroscience 7: 288. DOI: https://doi.org/10.3389/fnhum.2013.00288.368213223785330
  17. Furnham, A., L. Forde, and K. Ferrari. 1999. “Personality and Work Motivation.” Personality and Individual Differences 26 (6): 1035–1043. DOI: https://doi.org/10.1016/S0191-8869(98)00202-5.
  18. Galesic, M., and M. Bosnjak. 2009. “Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey.” Public Opinion Quarterly 73 (2): 349–360. DOI: https://doi.org/10.1093/poq/nfp031.
  19. Griffin, D.H. 2002. “Measuring Survey Nonresponse by Race and Ethnicity.” In Proceedings of the Annual Meetings of the American Statistical Association, August 2002: 11–15. Alexandria, VAL: American Statistical Association. Available at: https://nces.ed.gov/FCSM/pdf/IHSNG_asa02_DG.pdf (assessed October 2021)
  20. Groves, R.M., E. Singer, and A. Corning. 2000. “Leverage-Saliency Theory of Survey Participation: Description and an Illustration.” The Public Opinion Quarterly 64 (3): 299–308. DOI: https://doi.org/10.1086/317990.11114270
  21. Guo, Y., J.A. Kopec, J. Cibere, L.C. Li, and C.H. Goldsmith. 2016. “Population Survey Features and Response Rates: A Randomized Experiment.” American Journal of Public Health 106 (8): 1422–1426. DOI: https://doi.org/10.2105/AJPH.2016.303198.494064127196650
  22. Harkness, J.A., M.E. Braun, B.E. Edwards, T.P. Johnson, L.E. Lyberg, P.Ph. Mohler, B.-E.E. Pennell, and T.W. Smith. 2010. Survey Methods in Multinational, Multiregional, and Multicultural Contexts. Hoboken, NJ: Wiley.10.1002/9780470609927
  23. Harkness, J.A., F.J.R. van de Vijver, P.Ph. Mohler, and J. Wiley. 2003. Cross-Cultural Survey Methods. 325. Hoboken, NJ: Wiley.
  24. Harris-Kojetin, B.A., and C. Tucker. 1998. “Longitudinal Nonresponse in the Current Population Survey (CPS).” In International Workshop on Household Survey Nonresponse, September 24, 1997: 263–272. Mannheim, Germany. Available at: https://www.ssoar.info/ssoar/bitstream/handle/document/49724/ssoar-1998-harris-kojetin_et_al-Longitudinal_nonresponse_in_the_Current.pdf?sequence=1=y=ssoar-1998-harris-kojetin_et_al-Longitudinal_nonresponse_in_the_Current.pdf (assessed October 2021).
  25. Heckathorn, D.D. 2007. “6. Extensions of Respondent-Driven Sampling: Analyzing Continuous Variables and Controlling for Differential Recruitment.” Sociological Methodology 37 (1): 151–208. DOI: https://doi.org/10.1111/j.1467-9531.2007.00188.x.
  26. Hill, D.H., and R.J. Willis. 2001. “Reducing Panel Attrition: A Search for Effective Policy Instruments.” Journal of Human Resources: 416–38. DOI: https://doi.org/10.2307/3069625.
  27. Koitsalu, M., M. Eklund, J. Adolfsson, H. Grönberg, and Y. Brandberg. 2018. “Effects of Pre-Notification, Invitation Length, Questionnaire Length and Reminder on Participation Rate: A Quasi-Randomised Controlled Trial.” BMC Medical Research Methodology 18 (1): 1–5. DOI: https://doi.org/10.1186/s12874-017-0467-5.575633529304734
  28. Lee, S, and N. Schwarz. 2014. “Question Context and Priming Meaning of Health: Effect on Differences in Self-Rated Health between Hispanics and Non-Hispanic Whites.” American Journal of Public Health 104 (1): 179–185. DOI: https://doi.org/10.2105/AJPH.2012.301055.391002223678900
  29. Lucas, R.E., E. Diener, A. Grob, E.M. Suh, and L. Shao. 2000. “Cross-Cultural Evidence for the Fundamental Features of Extraversion.” Journal of Personality and Social Psychology 79 (3): 452. DOI: https://doi.org/10.1037//0022-3514.79.3.452.10981846
  30. Lugtig, P. 2014. “Panel Attrition: Separating Stayers, Fast Attriters, Gradual Attriters, and Lurkers.” Sociological Methods & Research 43 (4): 699–723. DOI: https://doi.org/10.1177/0049124113520305.
  31. Marcus, B., M. Bosnjak, S. Lindner, S. Pilischenko, and A. Schütz. 2007. “Compensating for Low Topic Interest and Long Surveys: A Field Experiment on Nonresponse in Web Surveys.” Social Science Computer Review 25 (3): 372–383. DOI: https://doi.org/10.1177/0894439307297606.
  32. McCarthy, J.S., D.G. Beckler, and S.M. Qualey. 2006. “An Analysis of the Relationship between Survey Burden and Nonresponse: If We Bother Them More, Are They Less Cooperative?” Journal of Official Statistics 22 (1): 97 – 112. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/an-analysis-ofthe-relationship-between-survey-burden-and-nonresponse-if-we-bother-them-more-are-they-less-cooperative.pdf.
  33. McCrae, R.R. 2004. “Human Nature and Culture: A Trait Perspective.” Journal of Research in Personality 38 (1): 3–14. DOI: https://doi.org/10.1016/j.jrp.2003.09.009.
  34. McCrae, R.R., and P.T. Costa Jr. 2008. “The Five-Factor Theory of Personality.” Handbook of interpersonal psychology: Theory, research, assessment, and therapeutic interventions: 91-104. Hoboken, NJ: Wiley.
  35. Nicoletti, C., and F. Peracchi. 2005. “Survey Response and Survey Characteristics: Microlevel Evidence from the European Community Household Panel.” Journal of the Royal Statistical Society: 168 (4): 763–781. DOI: https://doi.org/10.1111/j.1467-985X.2005.00369.x.
  36. Oakland, R.J., and J.S. Oakland. 2018. Statistical Process Control. London, UK: Routledge.10.4324/9781315160511
  37. Ono, M., S. Schneider, D.U. Junghaenel, and A.A. Stone. 2019. “What Affects the Completion of Ecological Momentary Assessments in Chronic Pain Research? An Individual Patient Data Meta-Analysis.” Journal of Medical Internet Research 21 (2): e11398. DOI: https://doi.org/10.2196/11398.637981530720437
  38. Pennell, B.-E., A. Bowers, D. Carr, S. Chardoul, G.-Q. Cheung, K. Dinkelmann, N. Gebler, S.E. Hansen, S. Pennell, and M. Torres. 2004. “The Development and Implementation of the National Comorbidity Survey Replication, the National Survey of American Life, and the National Latino and Asian American Survey.” International Journal of Methods in Psychiatric Research 13 (4): 241–269. DOI: https://doi.org/10.1002/mpr.180.687845115719531
  39. Saßenroth, D. 2013. “Personality Effects on Participation in the LISS Panel.” In The Impact of Personality on Participation Decisions in Surveys, 129–160. Berlin, Germany: Springer.10.1007/978-3-658-01781-1_5
  40. Schroepfer, T.A., J. Matloub, P. Creswell, R. Strickland, and D.M. Anderson. 2009. “A Community-Specific Approach to Cancer Research in Indian Country.” Progress in Community Health Partnerships: Research, Education, and Action 3 (4): 317. DOI: https://doi.org/10.1353/cpr.0.0096.304989420097993
  41. Sharp, L.M., and J. Frankel. 1983. “Respondent Burden: A Test of Some Common Assumptions.” Public Opinion Quarterly 47 (1): 36–53. DOI: https://doi.org/10.1086/268765.
  42. Smillie, L.D. 2013. “Extraversion and Reward Processing.” Current Directions in Psychological Science 22 (3): 167–172. DOI: https://doi.org/10.1177/0963721412470133.
  43. Stone, A.A., J.E. Broderick, J.E. Schwartz, S. Shiffman, L. Litcher-Kelly, and P. Calvanese. 2003. “Intensive Momentary Reporting of Pain with an Electronic Diary: Reactivity, Compliance, and Patient Satisfaction.” Pain 104 (1–2): 343–351. DOI: https://doi.org/10.1016/s0304-3959(03)00040-x.12855344
  44. Stueve, A., L.N. O’Donnell, R. Duran, A. San Doval, and J. Blome. 2001. “Time-Space Sampling in Minority Communities: Results with Young Latino Men Who Have Sex with Men.” American Journal of Public Health 91 (6): 922. DOI: https://doi.org/10.2105/ajph.91.6.922.144646911392935
  45. Sun, H. 2012. Cross-Cultural Technology Design: Creating Culture-Sensitive Technology for Local Users. Oxford, UK: Oxford University Press10.1093/acprof:oso/9780199744763.001.0001
  46. Tourangeau, R., B. Edwards, T.P. Johnson, K.M. Wolter, and N. Bates. 2014. Hard-to-Survey Populations. Cambridge, UK: Cambridge University Press.10.1017/CBO9781139381635
  47. U.S. Bureau of Labor Statistics. n.d. Average Hourly and Weekly Earnings of All Employees on Private Nonfarm Payrolls by Industry Sector, Seasonally Adjusted. Available at: https://www.bls.gov/news.release/empsit.t19.htm (Assessed May 2021)
  48. UAS (Understanding American Study). Available at: https://uasdata.usc.edu/index.php (accessed October 2022).
  49. Venables, W.N., and B.D. Ripley. 2013. Modern Applied Statistics with S-PLUS. Berlin, Germany: Springer Science & Business Media.
  50. Walsh, E., and J.K. Brinker. 2015. “Temporal Considerations for Self-Report Research Using Short Message Service.” Journal of Media Psychology 28 (4): 200–206. DOI: https://doi.org/10.1027/1864-1105/a000161.
  51. Walsh, R., and J.M. Fields. 2012. “Reducing Respondent Burden: Evaluating the Progress of the SIPP-EHC.” In Federal Committee on Statistical Methodology 2012 Biennial Conference. FCSM, Washington, DC. Available at: https://nces.ed.gov/FCSM/pdf/-Walsh_2012FCSM_IX-B.pdf (Assessed October 2021).
  52. Yetter, G., and K. Capaccioli. 2010. “Differences in Responses to Web and Paper Surveys among School Professionals.” Behavior Research Methods 42 (1): 266–272. DOI: https://doi.org/10.3758/BRM.42.1.266.20160305
  53. Zabel, J.E. 1998. “An Analysis of Attrition in the Panel Study of Income Dynamics and the Survey of Income and Program Participation with an Application to a Model of Labor Market Behavior.” Journal of Human Resources: 479–506. DOI: https://doi.org/10.2307/146438.
Language: English
Page range: 1051 - 1067
Submitted on: Jan 1, 2021
|
Accepted on: Oct 1, 2021
|
Published on: Dec 3, 2022
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2022 Haomiao Jin, Arie Kapteyn, published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.