Skip to main content
Have a personal or library account? Click to login
Evaluation Framework of Citizen Science Revisited Cover

Evaluation Framework of Citizen Science Revisited

Open Access
|Nov 2026
Read online

References

  1. Allf, B., Larson, L., Goodwin, J., Dunn, R., and Cooper, C. (2025). Fun surveys? Developing an innovative approach to assessing learning through citizen science. Citizen Science: Theory and Practice. DOI: 10.5334/cstp.796
  2. Anderson, A. (2004) The community builder‘s approach to theory of change. Aspen Institute, 2004. https://www.theoryofchange.org/pdf/TOC_fac_guide.pdf
  3. Andresz, S., Marchand-Moury, A., Goyette-Pernot, J., Rivière, A.L., and Schieber, C. (2023) When citizen science meets radon building diagnosis: Synthesis of a French pilot project developed in the framework of the European RadoNorm research project, Open Research Europe 2023, 3:106. DOI: 10.12688/openreseurope.15968.1
  4. Angelidakis, S., Avgitas, T., Chaniotakis, E., Casado, J., Coyle, P., De Wasseige, G., Di Renzo, F., et al. (2024) Citizen science, accessibility, art & science, critical thinking, policy and engagement: thoughts and lessons learned from the REINFORCE experience. The European Physical Journal Plus 139, 868. DOI: 10.1140/epjp/s13360-024-05313-w
  5. Aristeidou, M. and Herodotou, C. (2020) Online citizen science: a systematic review of effects on learning and scientific literacy. Citizen Science: Theory and Practice. DOI: 10.5334/cstp.224
  6. Bonn, A., Hecker, S., Bowser, A., Makuch, Z., Vogel, J., and Haklay, M. (2018) Citizen science to foster innovation in open science, society and policy. Innovation in Open Science, Society and Policy. DOI: 10.2307/j.ctv550cf2.38
  7. Calyx, C. and Finlay, S.M. (2022) Improving a framework for evaluating participatory science. Available at SSRN: https://ssrn.com/abstract=4173609
  8. Ceccaroni, L., Parkinson, S., Woods, S., Sprinks, J., When, U., Scrieciu, A., Kozak, B., et al. (2022) The impact of citizen science on society, governance, the economy, the environment and science. Zenodo. DOI: 10.5281/zenodo.7124258
  9. D’Andrea, L., Schmidt, E., Bužan, E., Merino, M., Dall, E., Colonnello, C., Graversen, et al. (2022) Evaluating citizen science initiatives through a citizen science-based approach. fteval JOURNAL for Research and Technology Policy Evaluation. DOI: 10.22163/fteval.2022.570
  10. Davis, C., Del Bianco, V., Peterman, K., Grover, A., Phillips, T., and Becker-Klein, R. (2022) Diverse and important ways wvaluation can support and advance citizen science. Citizen Science: Theory and Practice. DOI: 10.5334/cstp.482
  11. ECSA (European Citizen Science Association). (2015) Ten principles of citizen science. Berlin. DOI: 10.17605/OSF.IO/XPR2N
  12. Fraisl, D., See, L., Fritz, S., Haklay, M., and McCallum, I. (2025) Leveraging the collaborative power of AI and citizen science for sustainable development. Nature Sustainability 8, 125–132 (2025). DOI: 10.1038/s41893-024-01489-2
  13. Gignac, F., Gresle, A.S.,Santoro Lamelas, V.,Yepes-Baldó, M., de la Torre, L., Pinazo, M. J., and InSPIRES Consortium. (2021) Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool, Research Evaluation, Volume 30, Issue 4. DOI: 10.1093/reseval/rvab026
  14. Gerke, D.M., Uude, K., and Kliewe, T. (2023) Co-creation and societal impact: Toward a generic framework for research impact assessment. Evaluation, 29(4), 489–508. DOI: 10.1177/13563890231195906
  15. Heinisch, B. (2021) Reaching the limits of co-creation in citizens: How to cite science – exemplified by the linguistic citizen humanities project ‘On everyone’s mind and lips – German in Austria’. JCOM – Journal of Science Communication 20 (06), A05. DOI: 10.22323/2.20060205.
  16. Hjelm, R. (2023) Small but mighty: Learning outcomes and impacts of microplastic focused citizen science. Master Thesis Series in Environmental Studies and Sustainability Science.
  17. Hoedoafia, M.A., Martel, l. M., and Perko, T. (2024) Evaluating citizen science projects: insights from radon research. Frontiers in Environmental Science 12:1436283. DOI: 10.3389/fenvs.2024.1436283
  18. Howells, L., Muller, I., Baker, A., Owen, T., Davies, F., Ridd, M., Mitchell, E., et al. (2024) Can an online approach to citizen science revolutionise clinical trials?. The European Health Psychologist, 23(1), 1103–1110.
  19. Hughes, C., Tremblett, K., Kummer, J., Lee, T. S., and Duke, D. (2022) How can we do citizen science better? A case study evaluating grizzly bear citizen science using principles of good practice in Alberta, Canada. Animals, 12(9), 1068. DOI: 10.3390/ani12091068
  20. Janssen, J., Bogert, M., Gold, M., and De Vries, S. (2025) Evaluating participant outcomes in the weather monitoring citizen science project “Delft Meet Regen”. Citizen Science: Theory and Practice, 10(1). DOI: 10.5334/cstp.757
  21. Jenkins, T., Fayet, L., Fayet, A., Chollet, D., Depraz, Y., Dumaz, M., Ricci, N. et al. (2025) CoFish: co-designing citizen science between fishers and scientists to monitor the phosphorus distribution across two lake Geneva basins. BMC Ecology and Evolution 25, 139 (2025). DOI: 10.1186/s12862-025-02472-x
  22. Kasperowski, D., Kullenberg, C., and Mäkitalo, Å. (2017) Embedding citizen science in research: forms of engagement, scientific output and values for science, policy and society. DOI: 10.31235/osf.io/tfsgh (accessed 11 November 2019).
  23. Kieslinger, B., Schäfer, T., and Fabian, C.M. (2015) Kriterienkatalog zur Bewertung von Citizen Science Projekten und Projektanträgen. Studie im Auftrag des Bundesministerium für Wissenschaft, Forschung und Wirtschaft (bmwfw).
  24. Kieslinger, B., Schäfer, T., Heigl, F., Dörler, D., Richter, A., and Bonn, A. (2018) Evaluating citizen science: towards an open framework. In: Hecker, S. et al. (eds.), Citizen Science – Innovation in Open Science, Society and Policy. London: UCL Press. DOI: 10.2307/j.ctv550cf2.13
  25. Kieslinger, B., Schäfer, T., Heigl, F., Dörler, D., Richter, R., and Bonn, A. (2017) The challenge of evaluation: an open framework for evaluating citizen science activities. SocArXiv. September 20. DOI: 10.17605/OSF.IO/ENZC9
  26. Kieslinger, B., Schuerz, S., Mayer, K., and Schaefer, T. (2022) CoAct D7.4 Final impact assessment report: evaluation results, overall impact assessment and final reflections on co-evaluation. Zenodo. DOI: 10.5281/zenodo.7468546
  27. Kocman, D., Števanec, T., Novak, R., and Kranjec, N. (2020) Citizen science as part of the primary school curriculum: a case study of a technical day on the topic of noise and health. Sustainability, 12(23), 10213. DOI: 10.3390/su122310213
  28. Kox, T., Rust, H.W., Wentzel, B., Göber, M., Böttcher, C., Lehmke, J., Freundl, E., et al. (2021) Build and measure: students report weather impacts and collect weather data using self-built weather stations. Australasian Journal of Disaster and Trauma Studies, 25(3), 79–86.
  29. Liu, H., Ahmed, S., Passani, A., and Bartonova, A. (2023) Understanding the role of cities and citizen science in advancing sustainable development goals across Europe: insights from European research framework projects. Frontiers in Sustainable Cities. DOI: 10.3389/frsc.2023.1219768
  30. Lorenz, U., Norvoll, R., Garcia, I., Franco, S., Canto, P., Saumer, M., and Matthes, J. (2023) D4.4 Report on impact assessment of YouCount. Zenodo. DOI: 10.5281/zenodo.10410661
  31. Palma, E., Mata, L., Cohen, K., Evans, D., Gandy, B., Gaskell, N., Hatchman, H., et al. (2024) The city nature challenge: A global citizen science phenomenon contributing to biodiversity knowledge and informing local government practices. BioScience, Volume 74, Issue 4, April 2024, Pages 290–299. DOI: 10.1093/biosci/biae012
  32. Passani, A., Janssen, A.L., and Hoelscher, K. (2020). Impact assessment methodological framework v1. Zenodo. https://zenodo.org/records/4432132#.YMn_e25CT0p
  33. Peter, M., Diekötter, T., and Kremer, K. (2019). Participant outcomes of biodiversity citizen science projects: a systematic literature review. Sustainability. DOI: 10.3390/su11102780
  34. Phillips, T., Faulkner, H., Ferguson, M., Minarchek, M., Porticella, N., and Bonney, R. (2018) User’s guide for evaluating learning outcomes in citizen science. Citizen Science: Theory and Practice, 3(1). DOI: 10.5334/cstp.126
  35. Skaržauskienė, A., Angelidou, M., Politis, C.R., Athanasiadou, E., and Maciuliene, M. (2024) Monitoring citizen science performance: methodological guidelines. Contemporary Economics, Vol. 18, Iss. 1, pp. 67–86. DOI: 10.5709/ce.1897-9254.526
  36. Schaaf, J., Khouri, A., Zerr, T., Scheidt, J., Neff, M., and Storf, H. (2024) Rare diseases in citizen science–preliminary experiences in developing a personal health app. MEDINFO 2023. IOS Press. DOI: 10.3233/SHTI231145
  37. Schaefer, T., Fabian, C.M., and Kieslinger, B. (2023) D5.3: Final evaluation and impact assessment report. Zenodo. DOI: 10.5281/zenodo.7486205
  38. Schaefer, T., Kieslinger, B., Brandt, M., and van den Bogaert, V. (2021) Evaluation in citizen science: the art of tracing a moving target, in: Vohland, K. et al. (eds.), The Science of Citizen Science. e-Book. DOI: 10.1007/978-3-030-58278-4
  39. Schaefer, T., Kieslinger, B., and Fabian, C.M. (2019) CAPTOR D5.3: Final Impact Assessment Report. DOI: 10.5334/cstp.245
  40. Seus, S., Afghani, N., Foulds, C., Noreña, M., Kaur, S., and Wieser, P. (2023). Responsible research and innovation made simple. A comprehensive toolbox for embedding RRI in shared green deal activities. Accessed online: https://sharedgreendeal.eu/resources/responsible-research-and-innovation-made-simple-comprehensive-toolbox-embedding-rri
  41. Somerwill, L. and Wehn, U. (2022) How to measure the impact of citizen science on environmental attitudes, behaviour and knowledge? A review of state-of-the-art approaches. Environmental Sciences Europe (2022) 34:18. DOI: 10.1186/s12302-022-00596-1
  42. Sona, Z. (2021) Geisteswissenschaftliche Citizen Science-Projekte mit Open Data-Ansatz in deutschen Gedächtnisinstitutionen. Berliner Handreichungen zur Bibliotheks- und Informationswissenschaft; 466.
  43. Soria Aguirre, J.M., Váczi, O., Biró, M., Juhász, E., Soltész, Z., Barta, B., Márton, Z., et al. (2024) Citizen science for nature conservation in Hungary: a three-dimensional approach. Citizen Science: Theory and Practice, 9(1), p. 30. DOI: 10.5334/cstp.762
  44. Turrini, T., Dörler, D., Richter, A., Heigl, F., and Bonn, A. (2018) The threefold potential of environmental citizen science-Generating knowledge, creating learning opportunities and enabling civic participation. Biological Conservation, 225, 176–186. DOI: 10.1016/j.biocon.2018.03.024
  45. Unterfrauner, E., Fabian, C.M., Casado, J., de la Vega, G., Garcia, B., and Díaz-Merced, W. (2021) Citizen Science for all?. In International conference on human-computer interaction. Cham: Springer International Publishing. DOI: 10.1007/978-3-030-78092-0_21
  46. Vercammen, A., Park, C., Goddard, R., Lyons-White, J., and Knight, A. (2020) A reflection on the fair use of unpaid work in conservation. Conservation & Society, 18(4), 399–404. https://www.jstor.org/stable/26937306
  47. Walker, D., Smigaj, M., and Tani, M. (2020) The benefits and negative impacts of citizen science applications to water as experienced by participants and communities. Wiley Interdisciplinary Reviews: Water, 8. DOI: 10.1002/wat2.1488
  48. Wehn, U., Gharesifard, M., Ceccaroni, L., Joyce, H., Ajates, R., Woods, S., Bilbao, A., et al. (2021) Impact assessment of citizen science: state of the art and guiding principles for a consolidated approach. Sustainability Science 16, 1683–1699 (2021). DOI: 10.1007/s11625-021-00959-2
  49. Weisberg, D.S., Kovaka, K., Vaca, E., and Weisberg, M. (2023) LAVA-Lobos: Raising environmental awareness through community science in the Galápagos Islands. Citizen Science: Theory and Practice, 8(1): 1, pp. 1–13. DOI: 10.5334/cstp.423
  50. Weiss, C.H. (1998). Evaluation (2nd ed.). Prentice Hall.
  51. Woods, M., Ajates, R., Gulari, N., Coulson, S., and GROW Consortium. (2020) Co-evaluation tool. University of Dundee. DOI: 10.20933/100001180
  52. Wu, Y., Washbourne, C., and Haklay, M. (2022) Citizen science in China’s water resources monitoring: current status and future prospects. International Journal of Sustainable Development & World Ecology. DOI: 10.1080/13504509.2021.2013973
  53. Zhang, J., Chen, S., Cheng, C., Liu, Y., and Jennerjahn, T.C. (2023) Citizen science to support coastal research and management: insights from a seagrass monitoring case study in Hainan, China. Ocean & Coastal Management, 231, 106403. DOI: 10.1016/j.ocecoaman.2022.106403
DOI: https://doi.org/10.5334/cstp.1003 | Journal eISSN: 2057-4991
Language: English
Page range: 36 - 36
Submitted on: Feb 13, 2026
Accepted on: Sep 14, 2026
Published on: Nov 3, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services

© 2026 Teresa Holocher, Barbara Kieslinger, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.