Have a personal or library account? Click to login
Combining Multiple Methods in Establishment Questionnaire Testing: The 2017 Census of Agriculture Testing Bento Box Cover

Combining Multiple Methods in Establishment Questionnaire Testing: The 2017 Census of Agriculture Testing Bento Box

Open Access
|Jun 2018

References

  1. Couper, M. 2008. Designing Effective Web Surveys. Cambridge: Cambridge University Press.10.1017/CBO9780511499371
  2. Creswell, J.W. 2014. A Concise Introduction to Mixed Methods Research. Thousand Oaks, CA: Sage Publications, Inc.
  3. Dillman, D. and C. Redline. 2004. “Testing Paper Self-Administered Questionnaires: Cognitive Interview and Field Test Comparisons.” In Methods for Testing and Evaluating Survey Questionnaires, edited by S. Presser, J. Rothgeb, M. Couper, J. Lessler, E. Martin, J. Martin, and E. Singer, 299–317. New York: Wiley and Sons, Inc.10.1002/0471654728.ch15
  4. Edwards, W.S. and D. Cantor. 1991. “Toward a Response Model in Establishment Surveys.” In Measurement Errors in Surveys, edited by P. Biemer, R. Groves, L. Lyberg, N. Mathiowetz, and S. Sudman, 211–233. New York: Wiley and Sons, Inc.10.1002/9781118150382.ch12
  5. Forsyth, B., J. Rothgeb, and G. Willis. 2004. “Does Pretesting Make a Difference? An Experimental Test.” In Methods for Testing and Evaluating Survey Questionnaires, edited by S. Presser, J. Rothgeb, M. Couper, J. Lessler, E. Martin, J. Martin, and E. Singer, 525–546, New York: Wiley and Sons, Inc.10.1002/0471654728.ch25
  6. Fowler, F. 2004. “The Case for More Split-Sample Experiment in Developing Survey Instruments.” In Methods for Testing and Evaluating Survey Questionnaires, edited by S. Presser, J. Rothgeb, M. Couper, J. Lessler, E. Martin, J. Martin, and E. Singer, 173–188. New York: Wiley and Sons, Inc.10.1002/0471654728.ch9
  7. Groves, R.M., F.J. Fowler Jr, M. Couper, J. Lepkowski, E. Singer, and R. Tourangeau. 2009. Survey Methodology. New York: Wiley & Sons, Inc.
  8. Madans, J., K. Miller, A. Maitland, and G. Willis. 2011. Question Evaluation Methods: Contributing to the Science of Data Quality. New York: Wiley & Sons, Inc.10.1002/9781118037003
  9. McCarthy, J. 2013. “Getting Your Money’s Worth: Targeting Resources to Make Cognitive Interviews Most Effective.” In Proceedings of the Section on Survey Research Methods: American Statistical Association. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/sections/srms/Proceedings/ (accessed November 2017).
  10. McCarthy, J. 2016. “Planning Your Multi-method Questionnaire Testing Bento Box: Examples from the 2017 Census of Agriculture Testing.” Paper presented at the 2016 International Conference on Questionnaire Design, Development, Evaluation, and Testing (QDET2). Miami, Florida. Available at: https://ww2.amstat.org/meetings/qdet2/OnlineProgram/Program.cfm (accessed November 2017).
  11. McCarthy, J. 2017. “Multi-use Field Testing: Examples from the 2017 Census of Agriculture Dry Run.” In Proceedings of the Section on Survey Research Methods: American Statistical Association. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/sections/srms/Proceedings/ (accessed November 2017).
  12. McCarthy, J. and D. Buysse. 2010. “Bento Box Questionnaire Testing: Multi-Method Questionnaire Testing for the 2012 Census of Agriculture.” In Proceedings of the Section on Survey Research Methods: American Statistical Association. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/sections/srms/Proceedings/ (accessed November 2017).
  13. Moore, D., K. Ott, and A. Gertseva. 2016. “Developing and Evaluating a Short Form: Results and Recommendations from Tests of a Form Designed to Reduce Questionnaire Length.” In Proceedings of the Fifth International Conference of Establishment Surveys, June 20–23, 2016. Geneva, Switzerland: American Statistical Association.
  14. Office of Management and Budget. 2016. Statistical Policy Working Paper 47: Evaluating Survey Questions: An Inventory of Methods. Washington, DC.
  15. Olson, K. 2010. “An Examination of Questionnaire Evaluation by Expert Reviewers.” Field Methods 22(4): 295–318.10.1177/1525822X10379795
  16. Ott, K., P. McGovern, and R. Sirkis. 2016. “Using Analysis of Field Test Results to Evaluate Questionnaire Performance.” In Proceedings of the Fifth International Conference of Establishment Surveys, June 20–23, 2016. Geneva, Switzerland: American Statistical Association.
  17. Persson, A., A. Bjornram, E. Elvers, and E. Erikson. 2015. “A Strategy to Test Questionnaires at a National Statistical Office.” Statistical Journal of the IAOS 31: 297–304.10.3233/sji-140863
  18. Phipps, P. S. Butani, and Y. Chun. 1995. “Research on Establishment Survey Questionnaire Design.” Journal of Business and Economic Statistics 7: 337–346.10.1080/07350015.1995.10524607
  19. Presser, S., and J. Blair. 1994. “Survey Pretesting: Do Different Methods Produce Different Results?” Sociological Methodology 24: 73–104.10.2307/270979
  20. Presser, S., J. Rothgeb, M. Couper, J. Lessler, E. Martin, J. Martin, and E. Singer. 2004. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley and Sons, Inc.10.1002/0471654728
  21. Ridolfo, H., V. Harris, J. McCarthy, D. Miller, N. Sedransk, and L. Young. 2016. “Developing and Testing New Survey Questions: The Example of New Questions on the Role of Women and New/Beginning Farm Operators.” In Proceedings of the Fifth International Conference of Establishment Surveys, June 20-23, 2016, Geneva, Switzerland: American Statistical Association.
  22. Schaeffer, N.C. and J. Dykema. 2004. “A Multiple-Method Approach to Improving the Clarity of Closely Related Concepts.” In Methods for Testing and Evaluating Survey Questionnaires, edited by S. Presser, J. Rothgeb, M. Couper, J. Lessler, E. Martin, J. Martin, and E. Singer, 475–502. New York: Wiley and Sons, Inc.10.1002/0471654728.ch23
  23. Snijkers, G., G. Haraldsen, J. Jones, and D. Willimack. 2013. Designing and Conducting Business Surveys. New York: Wiley & Sons, Inc.10.1002/9781118447895
  24. Stettler, K., D. Willimack, and A. Anderson. 2001. “Adapting Cognitive Interview Methodologies to Compensate for Unique Characteristics of Establishments.” In Proceedings of the Section on Survey Research Methods: American Statistical Association. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/sections/srms/Proceedings/ (accessed November 2017).
  25. Tuttle, A., R. Morrison, and D. Willimack. 2010. “From Start to Pilot: A Multi-method Approach to the Comprehensive Redesign of an Economic Survey Questionnaire.” Journal of Official Statistics 26(1): 87–103.
  26. Willimack, D. 2013. “Methods for the Development, Testing, and Evaluation of Data Collection Instruments.” In Designing and Conducting Business Surveys, edited by Snijkers, G., G. Haraldsen, J. Jones, and D. Willimack, 253–301. New York: Wiley and Sons, Inc.10.1002/9781118447895.ch07
  27. Willimack, D. and E. Nichols. 2010. “A Hybrid Response Process Model for Business Surveys.” Journal of Official Statistics 26(1): 3–24.
  28. Willis, G.B. 2004. Cognitive Interviewing: A Tool for Improving Questionnaire Design. Thousand Oaks, CA: Sage Publications.
  29. Willis, G.B. 2015. Analysis of the Cognitive Interview in Questionnaire Design. Oxford: Oxford University Press.
  30. Yan, T., F. Kreuter, and R. Tourangeau. 2012. “Evaluating Survey Questions: A Comparison of Methods.” Journal of Official Statistics 2: 503–529.
Language: English
Page range: 341 - 364
Submitted on: Oct 1, 2016
|
Accepted on: Jan 1, 2018
|
Published on: Jun 7, 2018
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2018 Jaki S. McCarthy, Kathleen Ott, Heather Ridolfo, Pam McGovern, Robyn Sirkis, Danna Moore, published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.