Have a personal or library account? Click to login
Evaluating Citizen Science: Moving beyond Output Measures to Learner Behaviors, Interests, and Motivations Cover

Evaluating Citizen Science: Moving beyond Output Measures to Learner Behaviors, Interests, and Motivations

Open Access
|Jul 2024

References

  1. Alender, B. (2016) Understanding volunteer motivations to participate in citizen science projects: A Deeper look at water quality monitoring. Journal of Science Communication, 15(3), A04. DOI: 10.22323/2.15030204
  2. Blue Thumb (2019) Oklahoma Blue Thumb Final Report: January 1, 2019 – December 31, 2019. Oklahoma City, Oklahoma: Oklahoma Conservation Commission.
  3. Bonney, R, Ballard, H, Jordan, R, McCallie, E, Phillips, T, Shirk, J and Wilderman, CC. (2009a) Public Participation in Scientific Research: Defining the Field and Assessing Its Potential for Informal Science Education. A CAISE Inquiry Group Report. Washington, DC: Center for Advancement of Informal Science Education (CAISE).
  4. Bonney, R., Cooper, C.B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K.V., and Shirk, J. (2009b) Citizen science: A developing tool for expanding science knowledge and scientific literacy. BioScience, 59(11), pp. 977984. DOI: 10.1525/bio.2009.59.11.9
  5. Bonney, R., Phillips, T.B., Ballard, H.L., and Enck, J.W. (2016) Can citizen science enhance public understanding of science? Public Understanding of Science, 25(1), pp. 216. DOI: 10.1177/0963662515607406
  6. Bonney, R., Shirk, J.L., Phillips, T.B., Wiggins, A., Ballard, H.L., Miller-Rushing, A.J., and Parrish, J.K. (2014) Next steps for citizen science. Science, 343(6178), pp. 14361437. DOI: 10.1126/science.1251554
  7. Briggs, L.P., Stedman, R.C., and Krasny, M.E. (2014) Photo-elicitation methods in studies of children’s sense of place. Children, Youth and Environments, 24(3), pp. 153172. DOI: 10.7721/chilyoutenvi.24.3.0153
  8. Brossard, D., Lewenstein, B., and Bonney, R. (2005) Scientific knowledge and attitude change: The impact of a citizen science project. International Journal of Science Education, 27(9), pp. 10991121. DOI: 10.1080/09500690500069483
  9. Church, S.P., Payne, L.B., Peel, S., and Prokopy, L.S. (2018) Beyond water data: benefits to volunteers and to local water from a citizen science program. Journal of Environmental Planning and Management, 62(2), pp. 306326. DOI: 10.1080/09640568.2017.1415869
  10. Clary, E., and Snyder, M. (1991) A functional analysis of altruism and prosocial behavior: The case of volunteerism. Review of personality and social psychology, 12, pp. 119148.
  11. Conrad, C.C., and Hilchey, K.G. (2011) A review of citizen science and community-based environmental monitoring: Issues and opportunities. Environmental Monitoring and Assessment, 176, pp. 273291. DOI: 10.1007/s10661-010-1582-5
  12. Creswell, J.W., Klassen, A.C., Plano Clark, V.L., and Smith, K.C. (2011) Best Practices for Mixed Methods Research in the Health Sciences. Office of Behavioral and Social Science Research.
  13. Crall, A.W., Jordan, R., Holfelder, K., Newman, G.J., Graham, J., and Waller, D.M. (2013) The impacts of an invasive species citizen science training program on participant attitudes, behavior, and science literacy. Public Understanding of Science, 22(6), pp. 745764. DOI: 10.1177/0963662511434894
  14. Crowston, K., and Wiggins, A. (2011) Supporting citizen involvement in scientific research. Recreation, In HICSS 2011 SCI Workshop.
  15. Deci, E.L., Ryan, R.M., and Koestner, R. (2001) The pervasive negative effects of rewards on intrinsic motivation: Response to Cameron (2001). Review of Educational Research, 71(1), pp. 4351. DOI: 10.3102/00346543071001043
  16. De Moor, T., Rijpma, A., and Prats López, M. (2019) Dynamics of engagement in citizen science: Results from the “Yes, I do!” project. Citizen Science: Theory and Practice, 6(1). DOI: 10.5334/cstp.212
  17. Díaz, J.L., Codern-Bové, N., Zomeño, M.D., Lassale, C., Schröder, H., and Grau, M. (2021) Quantitative and qualitative evaluation of the COMPASS mobile app: a citizen science project. Informatics for Health and Social Care, 46(4), 412424. DOI: 10.1080/17538157.2021.1902332
  18. Dickinson, J.L., Shirk, J., Bonter, D., Bonney, R., Crain, R.L., Martin, J., Phillips, T., and Purcell, K. (2012) The current state of citizen science as a tool for ecological research and public engagement. Frontiers in Ecology and the Environment, 10(6), pp. 291297. DOI: 10.1890/110236
  19. Domroese, M.C., and Johnson, E.A. (2017) Why watch bees? Motivations of citizen science volunteers in the Great Pollinator Project. Biological Conservation, 208, 4047. DOI: 10.22323/2.15030204
  20. Falk, J.H., Storksdieck, M., and Dierking, L.D. (2007) Investigating public science interest and understanding: Evidence for the importance of free-choice learning. Public Understanding of Science, 16(4), pp. 455469. DOI: 10.1177/0963662506064240
  21. Frensley, T., Crall, A., Stern, M., Jordan, R., Gray, S., Prysby, M., Newman, G., Hmelo-Silver, C., Mellor, D., and Huang, J. (2017) Bridging the benefits of online and community supported citizen science: A case study on motivation and retention with conservation-oriented volunteers. Citizen Science: Theory and Practice, 2(1), pp. 44. DOI: 10.5334/cstp.84
  22. Friedman, A.J., Allen, S, Campbell, P.B., Dierking, L.D., Flagg, B.N., Garibay, C, Korn, R, Silverstein, G., and Ucko, D.A. (2008) Framework for evaluating impacts of informal science education projects. In Report from a National Science Foundation Workshop. The National Science Foundation, Division of Research on Learning in Formal and Informal Settings (Vol. 73).
  23. Geoghegan, H., Dyke, A., Pateman, R., West, S., and Everett, G. (2016) Understanding motivations for citizen science. Final report on behalf of UKEOF, University of Reading, Stockholm Environment Institute (University of York) and University of the West of England.
  24. Grudens-Schuck, N., and Sirajuddin, Z. (2019) Social impacts of citizen science water monitoring programs. Journal of Soil and Water Conservation, 74(3), pp. 49A54A. DOI: 10.2489/jswc.74.3.49A
  25. Hajibayova, L. (2020) (Un)theorizing citizen science: Investigation of theories applied to citizen science studies. Journal of the Association for Information Science and Technology, 71(8), pp. 916926. DOI: 10.1002/asi.24308
  26. Haklay, M. (2012) Citizen science and volunteered geographic information: Overview and typology of participation. Crowdsourcing geographic knowledge: Volunteered geographic information (VGI) in theory and practice, pp. 105122. DOI: 10.1007/978-94-007-4587-2_7
  27. Heimlich, J.E., and Ardoin, N.M. (2008) Understanding behavior to understand behavior change: a literature review. Environmental Education Research, 14(3), pp. 215237. DOI: 10.1080/13504620802148881
  28. Jacobson, S.K., Carlton, J.S., and Monroe, M.C. (2012) Motivation and satisfaction of volunteers at a Florida natural resource agency. Journal of Park and Recreation Administration, 30(1).
  29. Jordan, R.C., Ballard, H.L., and Phillips, T.B. (2012) Key issues and new approaches for evaluating citizen-science learning outcomes. Frontiers in Ecology and the Environment, 10(6), pp. 307309. DOI: 10.1890/110280
  30. Jordan, R.C., Gray, S.A., Howe, D.V., Brooks, W.R., and Ehrenfeld, J.G. (2011) Knowledge gain and behavioral change in citizen-science programs. Conservation Biology, 25(6), pp. 11481154. DOI: 10.1111/j.1523-1739.2011.01745.x
  31. Kieslinger, B., Schäfer, T., Heigl, F., Dörler, D., Richter, A. and Bonn, A. (2017) The challenge of evaluation: An open framework for evaluating citizen science activities. DOI: 10.31235/osf.io/enzc9
  32. Kirschke, S., Bennett, C., Ghazani, A.B., Kirschke, D., Lee, Y., Loghmani Khouzani, S.T., and Nath, S. (2023) Design impacts of citizen science. A comparative analysis of water monitoring projects. Frontiers in Environmental Science, 11. DOI: 10.3389/fenvs.2023.1186238
  33. Maltese, A.V. and Tai, R.H. (2010) Eyeballs in the fridge: Sources of early interest in science. International Journal of Science Education, 32(5), pp. 669685. DOI: 10.1080/09500690902792385
  34. Maund, P.R., Irvine, K N., Lawson, B., Steadman, J., Risely, K., Cunningham, A.A., and Davies, Z.G. (2020) What motivates the masses: Understanding why people contribute to conservation citizen science projects. Biological Conservation, 246, p. 108587. DOI: 10.1016/j.biocon.2020.108587
  35. Merenlender, A.M., Crall, A.W., Drill, S., Prysby, M., and Ballard, H. (2016) Evaluating environmental education, citizen science, and stewardship through naturalist programs. Conservation Biology, 30(6), pp. 12551265. DOI: 10.1111/cobi.12737
  36. Miller, K.A., Deci, E.L., and Ryan, R.M. (1988) Intrinsic motivation and self-determination in human behavior. Contemporary Sociology, 17(2), p. 253. DOI: 10.2307/2070638
  37. Nakayama, S., Torre, M., Nov, O., and Porfiri, M. (2019) Matching individual attributes with task types in collaborative citizen science. PeerJ Computer Science, 5, p. 209. DOI: 10.7717/peerj-cs.209
  38. National Research Council. (2009) Learning science in informal environments: People, places, and pursuits. Washington, DC: National Academies Press. DOI: 10.17226/12190
  39. Nov, O., Arazy, O., and Anderson, D. (2014) Scientists@Home: What drives the quantity and quality of online citizen science participation? PLoS ONE, 9(4), p. e90375. DOI: 10.1371/journal.pone.0090375
  40. Oklahoma Conservation Commission Water Quality Division. (2020) (rep.). Oklahoma Blue Thumb Final Report: January 1, 2020 – December 31, 2020. Oklahoma City, Oklahoma.
  41. Olson, C., and Colston, N. (2020) Blue Thumb Needs Review. Tulsa, Oklahoma: Oklahoma State University.
  42. Overdevest, C., Orr, C., and Stepenuck, K. (2004) Volunteer stream monitoring and local participation in natural resource issues. Research in Human Ecology, 11(2), pp. 177185.
  43. Palinkas, L.A., Mendon, S.J. and Hamilton, A.B. (2019) Innovations in mixed methods evaluations. Annual Review of Public Health, 40, pp. 423442. DOI: 10.1146/annurev-publhealth-040218-044215
  44. Pateman, R.M., Dyke, A., and West, S.E. (2021) The diversity of participants in environmental citizen science. Citizen Science: Theory and Practice, 6(1), p. 9. DOI: 10.5334/cstp.369
  45. Peter, M., Kremer, K., and Diekotter, T. (2019) Participant outcomes of biodiversity citizen science projects: A systematic literature review. Sustainability, 11(10). DOI: 10.3390/su11102780
  46. Phillips, T., Bonney, R., and Shirk J. (2012) What is our impact? Toward a unified framework for evaluating impacts of citizen science. In: Dickinson J.L. and Bonney R. (eds) Citizen Science: Public Collaboration in Environmental Research. Ithaca, NY: Cornell University Press, pp. 8296. DOI: 10.7591/cornell/9780801449116.003.0006
  47. Phillips, T., Ferguson, M., Minarchek, M., Porticella, N., and Bonney, R. (2014) Evaluating Learning Outcomes from Citizen Science. Cornell Lab of Ornithology, Ithaca.
  48. Phillips, T., Heimlich, J., and Ballard, H. (2017) General Environmental Stewardship Scale. Ithaca, NY: Cornell Lab of Ornithology.
  49. Phillips, T., Porticella, N., Bonney, R., and Grack-Nelson, A. (2015) Interest in Science and Nature Scale (Adult Version). Technical Brief Series. Ithaca, NY: Cornell Lab of Ornithology.
  50. Phillips, T., Porticella, N., Constas, M., and Bonney, R. (2018) A Framework for Articulating and Measuring Individual Learning Outcomes from Participation in Citizen Science. Citizen Science: Theory & Practice, 3(2). DOI: 10.5334/cstp.126
  51. Pocock, M.J., Hamlin, I., Christelow, J., Passmore, H.A., & Richardson, M. (2023) The benefits of citizen science and nature noticing activities for well being, nature connectedness and pro-nature conservation behaviours. People and Nature, 5(2), pp. 591606. DOI: 10.1002/pan3.10432
  52. Porticella, N., Phillips, T., and Bonney, R. (2017a) Motivation for Doing and Learning Science Scal. Ithaca, NY: Cornell Lab of Ornithology.
  53. Porticella, N., Phillips, T., and Bonney, R. (2017b) Motivation for Participating in Citizen Science. Ithaca, NY: Cornell Lab of Ornithology.
  54. Qualtrics. (2020) Qualtrics XM – Experience Management Software. Qualtrics.
  55. Raddick, M.J., Bracey, G., Gay, P.L., Lintott, C.J., Murray, P., Schawinski, K., Szalay, A.S., and Vandenberg, J. (2009) Galaxy zoo: Exploring the motivations of citizen science volunteers. Astronomy Education Review, 9(1), p. 010103. DOI: 10.3847/AER2009036
  56. Richter, A., Comay, O., Svenningsen, C.S., Larsen, J.C., Hecker, S., Tøttrup, A.P., Pe’er, G., Dunn, R.R., Bonn, A., and Marselle, M. (2021) Motivation and support services in citizen science insect monitoring: A cross-country study. Biological Conservation, 263, p. 109325. DOI: 10.1016/j.biocon.2021.109325
  57. Roche, J., Bell, L., Galvão, C., Golumbic, Y.N., Kloetzer, L., Knoben, N., Laakso, M., Lorke, J., Mannion, G., Massetti, L. and Mauchline, A. (2020) Citizen science, education, and learning: Challenges and opportunities. Frontiers in Sociology, 5, p. 613814. DOI: 10.3389/fsoc.2020.613814
  58. Rotman, D., Preece, J., Hammock, J., Procita, K., Hansen, D., Parr, C., Lewis, D. and Jacobs, D. (2012) Dynamic changes in motivation in collaborative citizen-science projects. Presented at the Computer Supported Cooperative Work 2012, pp. 217226. DOI: 10.1145/2145204.2145238
  59. Ryan, R.M., and Deci, E.L. (2000a) Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), p. 68. DOI: 10.1037/0003-066X.55.1.68
  60. Ryan, R.M., and Deci, E.L. (2000b) When rewards compete with nature: The undermining of intrinsic motivation and self-regulation. Intrinsic and extrinsic motivation: The search for optimal motivation and performance. San Diego, Ca: Academic Press. pp. 1454. DOI: 10.1016/B978-012619070-0/50024-6
  61. Santori, C., Keith, R.J., Whittington, C.M., Thompson, M.B., Van Dyke, J.U., and Spencer, R.J. (2021) Changes in participant behaviour and attitudes are associated with knowledge and skills gained by using a turtle conservation citizen science app. People and Nature, 3(1), pp. 6676. DOI: 10.1002/pan3.10184
  62. Stepenuck, K., and Genskow, K. (2017) Characterizing the breadth and depth of volunteer water monitoring programs in the United States. Environmental Management, 61, pp. 4657. DOI: 10.1007/s00267-017-0956-7
  63. Trumbull, D.J., Bonney, R., Bascom, D., and Cabral, A. (2000) Thinking scientifically during participation in a citizen-science project. Science Education, 84(2), pp. 265275. DOI: 10.1002/(SICI)1098-237X(200003)84:2<;265::AID-SCE7>3.0.CO;2-5
  64. Wells, N.M., and Lekies, K.S. (2012) Children and nature: Following the trail to environmental attitudes and behaviors. In: J. L. Dickinson and R. Bonney (Eds.) Citizen science: Public Participation in Environmental Research, pp. 201213.Ithaca, NY: Comstock Publishing Associates. DOI: 10.7591/cornell/9780801449116.003.0015
  65. West, S.E., Pateman, R.M., and Dyke, A. (2021) Variations in the motivations of environmental citizen scientists. Citizen Science: Theory and Practice, 6(1), p. 14. DOI: 10.5334/cstp.370
  66. Wu, Y., Li, C., and Khoo, S. (2016) Predicting future volunteering intentions through a self- determination theory perspective. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 27, pp. 12661279. DOI: 10.1007/s11266-015-9570-6
DOI: https://doi.org/10.5334/cstp.683 | Journal eISSN: 2057-4991
Language: English
Submitted on: Oct 5, 2023
|
Accepted on: Apr 26, 2024
|
Published on: Jul 2, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Cheyanne Olson, Nicole Colston, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.