Skip to main content
Have a personal or library account? Click to login
Journeys Toward Impact: A Critical Reflection on Participatory Evaluation in Five European Citizen Science Initiatives Cover

Journeys Toward Impact: A Critical Reflection on Participatory Evaluation in Five European Citizen Science Initiatives

Open Access
|Nov 2026
Read online

References

  1. Apgar, M. and Allen, W. (2021) Participatory monitoring, evaluation and learning: taking stock and breaking new ground. In: Burns, D., Howard, J. and Ospina, S. (eds.) Participatory Research and Inquiry. London: Sage. pp. 831–844. DOI: 10.4135/9781529769432.n58
  2. Calyx, C. and Finlay, S.M. (2022) Improving a framework for evaluating participatory science. Evaluation, 28(2), 150–165. DOI: 10.1177/13563890221085996.
  3. Ceccaroni, L. and Piera, J. (2017) Analyzing the Role of Citizen Science in Modern Research. Hershey, PA: IGI Global. DOI: 10.4018/978-1-5225-0962-2
  4. Cousins, J.B. and Alborhamy, Y. (2025) Theory-practice connections in collaborative approaches to evaluation: a systematic review of practice. American Journal of Evaluation. 46. DOI: 10.1177/10982140251355140
  5. Cousins, J.B. and Chouinard, J.A. (2012) Participatory evaluation up close: An integration of research-based knowledge. Charlotte, NC: Information Age Publishing. DOI: 10.1108/978-1-61735-803-6
  6. Cousins, J.B. and Whitmore, E. (1998) Framing participatory evaluation. New Directions for Evaluation, pp. 5–23. DOI: 10.1002/ev.1114
  7. Davis, C., Del Bianco, V., Peterman, K., Grover, A., Phillips, T. and Becker-Klein, R. (2022) Diverse and important ways evaluation can support and advance citizen science, Citizen Science: Theory and Practice, 7(1). DOI: 10.5334/cstp.482
  8. Fetterman, D. (1996) Empowerment evaluation: an introduction to theory and practice. In D. M. Fetterman, S. J. Kaftarian, A. Wandersman (eds.) Empowerment evaluation: An introduction to theory and practice (pp. 3–46). SAGE Publications, Inc. DOI: 10.4135/9781452243573.n1
  9. Fraisl, D., Haklay, M., Hager, G., Wehn, U., See, L., Hecker, S., Greshake Tzovaras, B., et al. (2026) Delineating the contours of citizen science: Development of the ECSA characteristics of citizen science [version 4; peer review: 4 approved]. Open Research Europe, 5:128. DOI: 10.12688/openreseurope.19411.4
  10. Fritz, S., See, L., Carlson, T., Haklay, M., Oliver, J., Fraisl, D. and Mondardini, R. (2019) Citizen Science and the United Nations Sustainable Development Goals. Nature Sustainability, October 2019, pp. 922–930. DOI: 10.1038/s41893-019-0390-3
  11. Gharesifard, M., Wehn, U. and van der Zaag, P. (2019) Context matters: a baseline analysis of contextual realities for two community-based monitoring initiatives of water and environment in Europe and Africa. Journal of Hydrology, 579, 124144. DOI: 10.1016/j.jhydrol.2019.124144
  12. Gugiu, P.C. and Rodríguez-Campos, L. (2007) Semi-structured interview protocol for constructing logic models. Evaluation and program planning, 30(4), pp. 339–350. DOI: 10.1016/j.evalprogplan.2007.08.004
  13. Haklay, M., Fraisl, D., Greshake Tzovaras, B., Hecker, S., Gold, M., Hager, G., Ceccaroni, L., et al. (2021) Contours of citizen science: A vignette study. Royal Society Open Science, 8: 202108. DOI: 10.1098/rsos.202108
  14. Irwin, A. (1995) Citizen Science: A Study of People, Expertise and Sustainable Development. Abingdon: Routledge.
  15. Kieslinger, B., Schürz, S., Mayer, K. and Schäfer, T. (2022) Participatory evaluation practices in citizen social science: Insights from three case studies, Journal for Research and Technology Policy Evaluation, 54, pp. 10–19. DOI: 10.22163/fteval.2022.567
  16. Kullenberg, C. and Kasperowski, D. (2016) What is citizen science? A scientometric meta-analysis. PloS one, 11(1), e0147152. DOI: 10.1371/journal.pone.0147152
  17. MacPhail, V.J. and Colla, S.R. (2020) Power of the people: A review of citizen science programs for conservation. Biological Conservation, 249, pp. 108739. DOI: 10.1016/j.biocon.2020.108739
  18. Newton, A. and Elliott, M. (2016) A Typology of stakeholders and guidelines for engagement in transdisciplinary, participatory processes. Frontiers in Marine Science, 3(230). DOI: 10.3389/fmars.2016.00230
  19. Passani, A., Janssen, A., Hölscher, K. and Di Lisio, G. (2022) A participatory, multidimensional and modular impact assessment methodology for citizen science projects. Journal for Research and Technology Policy Evaluation, (54), pp. 33–42. DOI: 10.22163/fteval.2022.569
  20. Pateman, R.M. and West, S.E. (2023) Citizen Science: Pathways to impact and why participant diversity matters. Citizen Science: Theory and Practice, 8(1):50, pp.1–15. DOI: 10.5334/cstp.569
  21. Reed, M.S., Graves, A., Dandy, N., Posthumus, H., Hubacek, K., Morris, J., Prell, C., Quinn, C.H. and Stringer, L.C. (2009) Who’s in and why? A typology of stakeholder analysis methods for natural resource management. Journal of Environmental Management, 90(5):1933–1949. DOI: 10.1016/j.jenvman.2009.01.001
  22. Schäfer, T. and Kieslinger, B. (2016) Supporting emerging forms of citizen science: A plea for diversity, creativity and social innovation. Journal of Science Communication, 15(2): Y02. DOI: 10.22323/2.15020402
  23. Schäfer, T., Kieslinger, B., Brandt, M. and van den Bogaert, V. (2021) Evaluation in Citizen Science: The art of tracing a moving target. In: Vohland, K., et al. (eds) The Science of Citizen Science. Cham: Springer, pp. 495–514. DOI: 10.1007/978-3-030-58278-4_25
  24. Shirk, J.L., Ballard, H.L., Wilderman, C.C., Phillips, T, Wiggins, A., Jordan, R., McCallie, E., et al. (2012) Public participation in scientific research: A framework for deliberate design. Ecology and Society, 17(2): 29. DOI: 10.5751/ES-04705-170229
  25. Skarlatidou, A. and Haklay, M. (2021) Citizen science impact pathways for a positive contribution to public participation in science. Journal of Science Communication, 20(6), A02. DOI: 10.22323/2.20060202
  26. Sprinks, J.C., Dowthwaite, L., Ceccaroni, L., Kiessling, T., Fraisl, D., Maccani, G., Solange Leal, A., et al. (2025) Supporting the upscaling of citizen science to address global challenges, Citizen Science: Theory and Practice, 10(1). DOI: 10.5334/cstp.837
  27. Strasser, B., Baudry, J., Mahr, D., Sanchez, G. and Tancoigne, E. (2019) “Citizen science”? Rethinking science and public participation. Science & Technology Studies, 32(2), pp. 52–76. DOI: 10.23987/sts.60425
  28. Strasser, B.J., Tancoigne, E., Baudry, J., Piguet, S., Spiers, H., Marquez, J.L-F., Kasparian, J., et al. (2023) Quantifying online citizen science: Dynamics and demographics of public participation in science. PLOS ONE, 18(11), e0293289. DOI: 10.1371/journal.pone.0293289
  29. Van Es, M., Guijt, I. and Vogel, I. (2015) Theory of Change thinking in practice. The Hague: Hivos. https://www.theoryofchange.nl/sites/default/files/resource/hivos_toc_guidelines_final_nov_2015.pdf.
  30. Wehn, U. (2022) Citizen Science for co-monitoring and co-managing impact on ecosystems and inland waters, chapter in Tockner, K. and Mehner, T. (eds) Encyclopedia of inland waters, Second Edition, Section 5 – Human pressures and management of Inland Waters, Elsevier, pp.35–36. DOI: 10.1016/B978-0-12-819166-8.00184-5
  31. Wehn, U., Ajates, R., Fraisl, D., Gharesifard, M., Gold, M., Hager, G., Oliver, J. L., See, L., Shanley, L.A., Ferri, M., Howitt, C., Monego, M., Pfeiffer, E. and Wood, C. (2021a) Capturing and communicating impact of citizen science for policy: A storytelling approach. Journal of Environmental Management, 295, 113082. DOI: 10.1016/j.jenvman.2021.113082
  32. Wehn, U., Bilbao, A., Somerwill, L., Linders, T., Maso, J., Parkinson, S., Semasingha, S. and Woods, S. (2025) Past and present marine citizen science around the globe: a cumulative inventory of initiatives and data produced. Ambio. 54, pp. 994–1009. DOI: 10.1007/s13280-024-02119-z
  33. Wehn, U., Gharesifard, M. and Ceccaroni, L. (2020). Impact-assessment methods adapted to citizen science. Deliverable report of H2020 project MICS. DOI: 10.5281/zenodo.6542324
  34. Wehn, U., Gharesifard, M., Ceccaroni, L., Joyce, H., Ajates, R., Woods, S., Bilbao, A., et al. (2021b) Impact assessment of citizen science: state of the art and guiding principles for a consolidated approach. Sustainability Science, 16(5), pp. 1683–1699. DOI: 10.1007/s11625-021-00959-2
  35. Wehn, U., Williams, C. and Ceccaroni, L. (2019) Ethics requirements: Participant informed-consent procedures. Deliverable report of H2020 project MICS. DOI: 10.5281/zenodo.4601151
  36. Wheatland, J., Joyce, H.M., Janes, M., Scrieciu, A., Kozák, B., Gumiero, B., Wehn, U., et al. (2021) Comprehensive evaluation report. Deliverable report of H2020 project MICS. DOI: 10.5281/zenodo.6542161
DOI: https://doi.org/10.5334/cstp.1025 | Journal eISSN: 2057-4991
Language: English
Page range: 39 - 39
Submitted on: Mar 30, 2026
Accepted on: Oct 5, 2026
Published on: Nov 6, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services

© 2026 Uta Wehn, Bruna Gumiero, Balazs Kozak, Hannah Joyce, Jonathan Wheatland, Albert Scrieciu, Stephen Parkinson, Mohammad Gharesifard, Luigi Ceccaroni, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.