References
- 1Alkin, MC and King, JA. 2016. The historical development of evaluation use. American Journal of Evaluation, 37(4): 568–579. DOI: 10.1177/1098214016665164
- 2Baker, E, Drury, JP, Judge, J, Roy, DB, Smith, GC and Stephens, PA. 2021. The verification of ecological citizen science data: Current approaches and future possibilities. Citizen Science: Theory and Practice, 6(1): 12. DOI: 10.5334/cstp.351
- 3Becker-Klein, R, Davis, C, Phillips, T, DelBianco, V, Grack Nelson, A and Christian Ronning, E. in review. Using a shared embedded assessment tool to understand participant skills: Processes and lessons learned. Citizen Science: Theory and Practice.
- 4Becker-Klein, R, Peterman, K and Stylinski, C. 2016. Embedded assessment as an essential method for understanding public engagement in citizen science. Citizen Science: Theory and Practice, 1(1). DOI: 10.5334/cstp.15
- 5Bell, P, Lewenstein, B, Shouse, AW and Feder, MA. (eds.) 2009. Learning Science in Informal Environments: People, Places, and Pursuits. Washington, DC: National Academies Press.
- 6Bowser, A, Cooper, C, De Sherbinin, A, Wiggins, A, Brenton, P, Chuang, TR, Faustman, E, Haklay, M and Meloche, M. 2020. Still in need of norms: The state of the data in citizen science. Citizen Science: Theory and Practice, 5(1). DOI: 10.5334/cstp.303
- 7Bundi, P, Frey, K and Widmer, T. 2021. Does evaluation quality enhance evaluation use? Evidence & Policy: A Journal of Research, Debate and Practice, 17(4): 661–687. DOI: 10.1332/174426421X16141794148067
- 8Burgess, HK, DeBeyb, LB, Froehlich, HE, Schmidt, N, Theobald, EJ, Ettinger, AK, HilleRisLambers, J, Tewksbury, H and Parrish, JK. 2017. The science of citizen science: Exploring barriers to use as a primary research tool. Biological Conservation, 208: 113–120. DOI: 10.1016/j.biocon.2016.05.014
- 9Davis, C, Del Bianco, V, Peterman, K, Grover, A, Phillips, T and Becker-Klein, R. 2022. Diverse and important ways evaluation can support and advance citizen science. Citizen Science: Theory and Practice, 7(1): 30. DOI: 10.5334/cstp.482
- 10Fenichel, M and Schweingruber, HA. 2010.
Surrounded by science: Learning science in informal environments . Board on Science Education, Center for Education, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press. - 11Freitag, A, Meyer, R and Whiteman, L. 2016. Strategies employed by citizen science programs to increase the credibility of their data. Citizen Science: Theory and Practice, 1(1). DOI: 10.5334/cstp.6
- 12Jackson, CB, Østerlund, C, Crowston, K, Harandi, M and Trouille, L. 2020. Shifting forms of engagement: volunteer learning in online citizen science. Proceedings of the ACM on Human–Computer Interaction, 4(CSCW1): 1–19. DOI: 10.1145/3392841
- 13Kelling, S, Johnston, A, Hochachka, WM, Iliff, M, Fink, D, Gerbracht, J, Lagoze, C, La Sorte, FA, Moore, T, Wiggins, A and Wong, WK. 2015. Can observation skills of citizen scientists be estimated using species accumulation curves? PloS One, 10(10): e0139600. DOI: 10.1371/journal.pone.0139600
- 14Kosmala, M, Wiggins, A, Swanson, A and Simmons, B. 2016. Assessing data quality in citizen science. Frontiers in Ecology and the Environment, 14(10): 551–560. DOI: 10.1002/fee.1436
- 15McNeill, N and Vastine, J. 2019.
Discovering unexpected outcomes mid-stream: Lessons learned from data interpretation affiliation: Alliance for Aquatic Resource Monitoring (ALLARM) . A panel presented at the biannual meeting of the Citizen Science Association. Atlanta, GA. - 16Miles, MB, Huberman, MA and Saldana, J. 2020. Qualitative Data Analysis: A Methods Sourcebook. Los Angeles: SAGE Publications.
- 17Parrish, JK, Burgess, H, Weltzin, JF, Fortson, L, Wiggins, A and Simmons, B. 2018. Exposing the science in citizen science: Fitness to purpose and intentional design. Integrative and Comparative Biology, 58(1): 150–160. DOI: 10.1093/icb/icy032
- 18Parrish, JK, Jones, T, Burgess, HK, He, Y, Fortson, L and Cavalier, D. 2019. Hoping for optimality or designing for inclusion: Persistence, learning, and the social network of citizen science. Proceedings of the National Academy of Sciences, 116(6): 1894–1901. DOI: 10.1073/pnas.1807186115
- 19Phillips, TB, Ferguson, M, Minarchek, M, Porticella, N and Bonney, R. 2014. User’s Guide for Evaluating Learning Outcomes in Citizen Science. Ithaca, NY: Cornell Lab of Ornithology.
- 20Phillips, T, Porticella, N, Constas, M and Bonney, R. 2018. A framework for articulating and measuring individual learning outcomes from participation in citizen science. Citizen Science: Theory and Practice, 3(2): 3. DOI: 10.5334/cstp.126
- 21Resnik, DB. 2019. Citizen scientists as human subjects: Ethical issues. Citizen Science: Theory and Practice, 4(1): 11, 1–7. DOI: 10.5334/cstp.150
- 22Richards, KAR and Hemphill, MA. 2018. A practical guide to collaborative qualitative data analysis. Journal of Teaching in Physical Education, 37(2): 225–231. DOI: 10.1123/jtpe.2017-0084
- 23Saldana, J. 2011. Fundamentals of Qualitative Research. Oxford: Oxford University Press.
- 24Simonis, JL and Pattengill-Semmens, CV. In prep. Quantifying and accounting for variable observer learning in volunteer-based biodiversity surveys.
- 25Stevenson, RD, Suomela, T, Kim, H and He, Y. 2021. Seven primary data types in citizen science determine data quality requirements and methods. Frontiers in Climate, 3: 645120. DOI: 10.3389/fclim.2021.645120
- 26Stylinski, CD, Peterman, K, Phillips, T, Linhart, J and Becker-Klein, R. 2020. Assessing science inquiry skills of citizen science volunteers: A snapshot of the field. International Journal of Science Education, Part B, 10(1): 77–92. DOI: 10.1080/21548455.2020.1719288
- 27Wiggins, A and Crowston, K. 2011, January.
From conservation to crowdsourcing: A typology of citizen science . In 2011 44th Hawaii international conference on system sciences (pp. 1–10). IEEE. DOI: 10.1109/HICSS.2011.207 - 28Wiggins, A, Newman, G, Stevenson, RD and Crowston, K. 2011, December.
Mechanisms for data quality and validation in citizen science . In 2011 IEEE Seventh international conference on e-Science Workshops (pp. 14–19). IEEE. DOI: 10.1109/eScienceW.2011.27 - 29Zevin, M, Coughlin, S, Bahaadini, S, Besler, E, Rohani, N, Allen, S, Cabero, M, Crowston, K, Katsaggelos, AK, Larson, SL and Lee, TK. 2017. Gravity Spy: integrating advanced LIGO detector characterization, machine learning, and citizen science. Classical and Quantum Gravity, 34(6): 064003. DOI: 10.1088/1361-6382/aa5cea