Have a personal or library account? Click to login
The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey Cover

The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey

Open Access
|Dec 2022

References

  1. AAPOR, The American Association for Public Opinion Research. 2016. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. AAPOR.
  2. American National Election Studies. 2020. The ANES Guide to Public Opinion and Electoral Behavior. Available at: https://electionstudies.org/resources/anes-guide/. (accessed December 2020).
  3. AmeriSpeak. 2020. AmeriSpeak Omnibus. Available at: https://amerispeak.norc.org/our-capabilities/Pages/AmeriSpeak-Omnibus.aspx?gclid=CjwKCAjwssD0BRBIEiwAJP5rIJ_c6ljPjrg0_H0mgV55cRzWceO-qX0X28KAaVkJX3X51Zk8APDvhoCJyo-QAvD_BwE. (accessed April 2020).
  4. Bolt, D.M., and T.R. Johnson. 2009. “Addressing Score Bias and Differential Item Functioning Due to Individual Differences in Response Style.” Applied Psychological Measurement 33(5): 335–352. DOI: https://doi.org/10.1177/0146621608329891.
  5. Bradburn, N.M. 1978. “Respondent Burden.” In Proceedings of the Survey Research Methods Section: American Statistical Association: 35–40. Alexandria, VA: American Statistical Association. Available at: http://www.asasrms.org/Proceedings/papers/1978_007.pdf. (accessed January 2021).
  6. Colsher, P.L. and R.B. Wallace. 1989. “Data Quality and Age: Health and Psychobehavioral Correlates of Item Nonresponse and Inconsistent Responses.” Journal of Gerontology 44(2): P45–P52. DOI: https://doi.org/10.1093/geronj/44.2.P45.
  7. De Leeuw, E.D. 1992. Data Quality in Mail, Telephone and Face to Face Surveys. Amsterdam: TT-pulikaties.
  8. Dillman, D.A., J.D. Smyth, and L.M. Christian. 2014. Internet, Phone, Mail, And Mixed-Mode Surveys: The Tailored Design Method. Hoboken: John Wiley & Sons, Inc.
  9. Galesic, M. 2006. “Dropouts on The Web: Effects of Interest and Burden Experienced During an Online Survey.” Journal of Official Statistics 22(2): 313–328. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/dropouts-onthe-web-effects-of-interest-and-burden-experienced-during-an-online-survey.pdf.
  10. Galesic, M. and M. Bosnjak. 2009. “Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey.” Public Opinion Quarterly 73(2): 349–360. DOI: https://doi.org/10.1093/poq/nfp031.
  11. Groves, R.M., F.J. Fowler Jr., M.P. Couper, J.M. Lepkowski, E. Singer, and R. Tourangeau. 2009. Survey Methodology. Hoboken: John Wiley & Sons, Inc.
  12. Hamby, T. and W. Taylor. 2016. “Survey Satisficing Inflates Reliability and Validity Measures: An Experimental Comparison of College and Amazon Mechanical Turk Samples.” Educational and Psychological Measurement 76(6): 912–932. DOI: https://doi.org/10.1177/0013164415627349.596560829795893
  13. Holbrook, A.L., Y.I. Cho, and T. Johnson. 2006. “The Impact of Question and Respondent Characteristics on Comprehension and Mapping Difficulties.” Public Opinion Quarterly 70(4): 565–595. DOI: https://doi.org/10.1093/poq/nfl027.
  14. Holbrook, A.L., M.C. Green, and J.A. Krosnick. 2003. “Telephone Versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias.” Public Opinion Quarterly 67(1): 79–125. DOI: https://doi.org/10.1086/346010.
  15. Holbrook, A.L., J.A. Krosnick, D. Moore, and R. Tourangeau. 2007. “Response Order Effects In Dichotomous Categorical Questions Presented Orally: The Impact of Question and Respondent Attributes.” Public Opinion Quarterly 71(3): 325–348. DOI: https://doi.org/10.1093/poq/nfm024.
  16. Kleinert, C., B. Christoph, and M. Ruland. 2019. “Experimental Evidence on Intermediate and Long-Term Consequences of Test-Induced Respondent Burden For Panel Attrition.” Sociological Methods & Research March 2019:1–32. DOI: https://doi.org/10.1177/0049124119826145.
  17. Knäuper, B., R.F. Belli, D.H. Hill, and A.R. Herzog. 1997. “Question Difficulty and Respondents’ Cognitive Ability: The Effect on Data Quality.” Journal of Official Statistics 13(2): 181–199. Available At: https://www.scb.se/contentassets/ca21efb41-fee47d293bbee5bf7be7fb3/question-difficulty-and-respondents39-cognitive-ability-the-effect-on-data-quality.pdf.
  18. Kogovšek, T. 2006. “Reliability and Validity of Measuring Social Support Networks by Web and Telephone.” Metodološki zvezki 3(2): 239–252. DOI: https://doi.org/10.51936/kjdq1083.
  19. Kogovšek, T., and A. Ferligoj. 2005. “Effects on Reliability and Validity of Egocentered Network Measurements.” Social Networks 27(3): 205–229. DOI: https://doi.org/10.1016/j.socnet.2005.01.001.
  20. Krosnick, J.A. 1991. “Response Strategies for Coping with The Cognitive Demands of Attitude Measures in Surveys.” Applied Cognitive Psychology 5: 213–236. DOI: https://doi.org/10.1002/acp.2350050305.
  21. Krosnick, J.A., S. Narayan, and W.R. Smith. 1996. “Satisficing in Surveys: Initial Evidence.” Causal Mechanisms in Program Evaluation 70: 29–44. DOI: https://doi.org/10.1002/ev.1033.
  22. Leeper, T.J. 2014. “Cognitive Style and the Survey Response.” Public Opinion Quarterly 78(4): 974–983. DOI: https://doi.org/10.1093/poq/nfu042.
  23. Lelkes, Y., J.A. Krosnick, D.M. Marx, C.M. Judd, and B. Park. 2012. “Complete Anonymity Compromises the Accuracy of Self-Reports.” Journal of Experimental Social Psychology 48(6): 1291–1299. DOI: https://doi.org/10.1016/j.jesp.2012.07.002.
  24. Manfreda, K.L., V. Vehovar, and V. Hlebec. 2004. “Collecting Ego-Centred Network Data Via the Web.” Metodološki zvezki 1(2): 295–321. DOI: https://doi.org/10.51936/sbuu6702.
  25. Marsden, P.V. 2016. “Survey Methods for Network Data.” In The SAGE Handbook of Social Network Analysis, edited by J. Scott and P.J. Carrington: 370–388. London: SAGE Publications Ltd.10.4135/9781446294413.n25
  26. McCarty, C., P.D. Killworth, and J. Rennell. 2007. “Impact of Methods for Reducing Respondent Burden on Personal Network Structural Measures.” Social Networks 29(2): 300–315. DOI: https://doi.org/10.1016/j.socnet.2006.12.005.
  27. Mondak, J.J. 1999. “Reconsidering the Measurement of Political Knowledge.” Political Analysis 8(1): 57–82. DOI: https://doi.org/10.1093/oxfordjournals.pan.a029805.
  28. Mondak, J.J. 2001. “Developing Valid Knowledge Scales.” American Journal of Political Science 45(1): 224–238. DOI: https://doi.org/10.2307/2669369.
  29. Nadeau, R., and R.G. Niemi. 1995. “The Process of Answering Factual Knowledge Questions in Surveys.” Public Opinion Quarterly 59(3): 323–346. DOI: https://doi.org/10.1086/269480.
  30. Narayan, S., and J.A. Krosnick. 1996. “Education Moderates Some Response Effects in Attitude Measurement.” Public Opinion Quarterly 60(1): 58–88. DOI: https://doi.org/10.1086/297739.
  31. Olson, K., J.D. Smyth, and A. Ganshert. 2018. “The Effects of Respondent and Question Characteristics on Respondent Answering Behaviors in Telephone Interviews.” Journal of Survey Statistics and Methodology 7(2): 275–308. DOI: https://doi.org/10.1093/jssam/smy006.
  32. Paik, A., and K. Sanchagrin. 2013. “Social Isolation in America: An Artifact.” Social Networks 78(3): 339–360. DOI: https://doi.org/10.1177/0003122413482919.
  33. Park, D.C. 2000. “The Basic Mechanisms Accounting For Age-Related Decline in Cognitive Function.” In Cognitive Aging: A Primer, edited by D.C. Park and N. Schwarz: 3–19. East Sussex: Psychology Press.
  34. Paulhus, D.L. 1991. “Measurement and control of response bias.” In Measures of Personality and Social Psychological Attitudes, edited by J.P. Robinson, P.R. Shaver, and L.S. Wrightsman: 19–59. San Diego, CA: Academic Press.10.1016/B978-0-12-590241-0.50006-X
  35. Perry, B.L., B.A. Pescosolido, and S.P. Borgatti. 2018. Egocentric Network Analysis: Foundations, Methods, and Models. Cambridge: Cambridge University Press.10.1017/9781316443255
  36. Smith, T.W., M. Davern, J. Freese, and S.L. Morgan. 2019. General Social Surveys, 1972–2018: Cumulative Codebook. Chicago: NORC University of Chicago. Available at: https://gss.norc.org/documents/codebook/gss_codebook.pdf. (accessed December 2020).
  37. Smith, T.W., and B. Schapiro. 2017. General Social Surveys – Panel Interviews: 2006–2014 Cumulative Codebook. Chicago: NORC University of Chicago. Available at: http://gss.norc.org/Documents/codebook/Panel%20Codebook.pdf. (accessed December 2020).
  38. Son, J. 2020. Email message to author, March 24, 2020. NORC at the University of Chicago.
  39. Sturgis, P., N. Allum, and P. Smith. 2008. “An Experiment on The Measurement of Political Knowledge in Surveys.” Public Opinion Quarterly 72(1): 90–102. DOI: https://doi.org/10.1093/poq/nfm032.
  40. The American National Election Studies. 2020. The ANES Guide to Public Opinion and Electoral Behavior. Available at: https://electionstudies.org/resources/anes-guide/. (accessed December 2020).
  41. Tourangeau, R. and K A. Rasinski. 1988. “Cognitive Processes Underlying Context Effects in Attitude Measurement.” Psychological Bulletin 103(3): 299–314. DOI: https://doi.org/10.1037/0033-2909.103.3.299.
  42. Tourangeau, R., L.J. Rips, and K.A. Rasinski. 2000. The Psychology of Survey Response. Cambridge: Cambridge University Press.10.1017/CBO9780511819322
  43. Tu, S. and P. Liao. 2007. “Social Distance, Respondent Cooperation and Item Nonresponse in Sex Survey.” Quality & Quantity 41:177-199. DOI: https://doi.org/10.1007/s11135-007-9088-0.
  44. U.S. Census Bureau. 2011. Age and Sex Composition: 2010. Available at: https://www.census.gov/prod/cen2010/briefs/c2010br-03.pdf. (accessed October 2021).
  45. Valente, T.W., L. Dougherty, and E. Stammer. 2017. “Response Bias Over Time: Interviewer Learning and Missing Data in Egocentric Network Surveys.” Field Methods 29(4): 303–316. DOI: https://doi.org/10.1177/1525822X17703718.
  46. Wetzel, E., C.H. Carstensen, and J.R. Böhnke. 2013. “Consistency of Extreme Response Style and Non-Extreme Response Style Across Traits.” Journal of Research in Personality 47(2): 178–189. DOI: https://doi.org/10.1016/j.jrp.2012.10.010.
  47. Zaller, J.R. 1992. The Nature and Origins of Mass Opinion. Cambridge: The Press Syndicate of the University of Cambridge.10.1017/CBO9780511818691
Language: English
Page range: 1019 - 1050
Submitted on: Jan 1, 2021
|
Accepted on: Mar 1, 2022
|
Published on: Dec 3, 2022
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2022 Angelica Phillips, Rachel Stenger, published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.