Skip to main content
Have a personal or library account? Click to login
A Typology for Evaluating Community Science: From Aspirational Goals to Measurable Outcomes Cover

A Typology for Evaluating Community Science: From Aspirational Goals to Measurable Outcomes

Open Access
|Aug 2026
Read online

References

  1. Ahmed, S.K., Mohammed, R.A., Nashwan, A.J., Ibrahim, R.H., Abdalla, A.Q., Ameen, B.M.M. and Khidhir, R.M. (2025) Using thematic analysis in qualitative research. Journal of Medicine, Surgery, and Public Health, [online] 6(6), p. 100198. DOI: 10.1016/j.glmedi.2025.100198
  2. Andrianandrasana, H.T., Randriamahefasoa, J., Durbin, J., Lewis, R.E. and Ratsimbazafy, J.H. (2005) Participatory ecological monitoring of the Alaotra wetlands in Madagascar. Biodiversity and Conservation, 14(11), pp. 2757–2774. DOI: 10.1007/s10531-005-8413-y
  3. Aristeidou, M. and Herodotou, C. (2020) Online citizen science: A systematic review of effects on learning and scientific literacy. Citizen Science: Theory and Practice, 5(1) . p. 11. DOI: 10.5334/cstp.224
  4. Becker-Klein, R., Davis, C., Phillips, T.B., Del Bianco, V., Grack Nelson, A. and Ronning, E.C. (2023) Using shared embedded assessment tools to understand participant skills: Processes and lessons learned. Citizen Science: Theory and Practice, 8(1), p. 20. DOI: 10.5334/cstp.487
  5. Benyei, P., Skarlatidou, A., Argyriou, D., Hall, R., Theilade, I., Turreira-García, N., Latreche, D. et al. (2023). Challenges, strategies, and impacts of doing citizen science with marginalised and indigenous communities: Reflections from project coordinators. Citizen Science: Theory and Practice 8(1), p. 21. DOI: 10.5334/cstp.514
  6. Bishop, I., Boldrini, A., Clymans, W., Hall, C., Moorhouse, H., Parkinson, S., Scott-Somme, K., Thornhill, I. and Loiselle, S. (2025) FreshWater Watch: Investigating the health of freshwater ecosystems, from the bottom up. Citizen Science: Theory and Practice, 10(1), pp. 1–16. DOI: 10.5334/cstp.754
  7. Boeije, H. (2002) A purposeful approach to the constant comparative method in the analysis of qualitative interviews. Quality and Quantity, 36, pp. 391–409. DOI: 10.1023/A:1020909529486
  8. Bullard, R. D. (1990). Dumping in Dixie: Race, Class, and Environmental Quality. Colorado: Westview Press.
  9. Cacari-Stone, L., Wallerstein, N., Garcia, A.P. and Minkler, M. (2014) The promise of community-based participatory research for health equity: a conceptual model for bridging evidence with policy. American Journal of Public Health, 104(9), pp. 1615–1623. DOI: 10.2105/ajph.2014.301961
  10. Cooper, C.B., Hawn, C.L., Larson, L.R., Parrish, J.K., Bowser, G., Cavalier, D., Dunn, R.R. et al. (2021) Inclusion in citizen science: The conundrum of rebranding. Science. 372(6540), pp. 1386–1388. DOI: 10.1126/science.abi6487
  11. Cornish, F., Breton, N., Moreno-Tabarez, U., Delgado, J., Rua, M., de-Graft Aikins, A. and Hodgetts, D. (2023) Participatory action research. Nature Reviews Methods Primers, 3(1), p. 34. DOI: 10.1038/s43586-023-00214-1
  12. Davis, C., Del Bianco, V., Peterman, K., Grover, A., Phillips, T. and Becker-Klein, R. (2022) Diverse and important ways evaluation can support and advance citizen science. Citizen Science: Theory and Practice, 7(1), p. 30. DOI: 10.5334/cstp.482
  13. Davis, L.F. and Ramírez-Andreotta, M.D. (2021) Participatory research for environmental justice: A critical interpretive synthesis. Environmental Health Perspectives, 129(2), pp. 026001. DOI: 10.1289/ehp6274
  14. de Weger E., Baan, C., Bos, C., Luijkx, K. and Drewes, H. (2022) ‘They need to ask me first’. Community engagement with low-income citizens. A realist qualitative case-study. Health Expectations, 25(2), pp. 684–696. DOI: 10.1111/hex.13415
  15. Del Bianco, V., Peterman, K., Becker-Klein, R., Davis, C.M., Grover, A. and Phillips, T. (2023) Cross-project analysis of volunteers’ scientific observation skills. Citizen Science: Theory and Practice, 8(1), p. 54. DOI: 10.5334/cstp.628
  16. Deutsch, W.G., Reutebuch, E. and Ruiz-Córdova, S.S. (2007) Validity and applications of citizen volunteer water-quality data: A case from Alabama. Water Resources Impact, 9(5), pp. 16–20. https://www.jstor.org/stable/10.2307/wateresoimpa.9.5.0016
  17. Doran, G.T. (1981) There’s a S.M.A.R.T. way to write management’s goals and objectives. Management Review, 70(11), pp. 35–36.
  18. Fernandez-Gimenez, M.E., Ballard, H.L. and Sturtevant, V.E. (2008) Adaptive management and social learning in collaborative and community-based monitoring: A study of five community-based forestry organizations in the western USA. Ecology and Society, 13(2), p. 4. https://www.jstor.org/stable/26267955
  19. Gibson, L. M., Busch, K. C., Stevenson, K. T., Cutts, B.B., DeMattia, E. A., Aguilar, O.M., Ardoin, N.M., et al. (2022) What is community-level environmental literacy, and how can we measure it? A report of a convening to conceptualize and operationalize CLEL. Environmental Education Research, 28(10), pp. 1423–1451. DOI: 10.1080/13504622.2022.2067325
  20. Granner, M.L. and Sharpe, P.A. (2004) Evaluating community coalition characteristics and functioning: a summary of measurement tools. Health Education Research, 19(5), pp. 514–532. DOI: 10.1093/her/cyg056
  21. Groulx, M., Brisbois, M.C., Lemieux, C.J., Winegardner, A. and Fishback, L. (2017) A role for nature-based citizen science in promoting individual and collective climate change action? A systematic review of learning outcomes. Science Communication, 39(1), pp. 45–76. DOI: 10.1177/1075547016688324
  22. Haklay, M. (2013) Citizen science and volunteered geographic information: Overview and typology of participation. In: Sui, D., Elwood, S. and Goodchild, M. (eds.) Crowdsourcing Geographic Knowledge. Dordrecht: Springer. pp. 105–122. DOI: 10.1007/978-94-007-4587-2_7
  23. Heath, S.C., Rabinovich, A. and Barreto, M. (2017) Putting identity into the community: Exploring the social dynamics of urban regeneration. European Journal of Social Psychology, 47(7), pp. 855–866. DOI: 10.1002/ejsp.2296
  24. Hsu, Y.-C., Dille, P., Cross, J., Dias, B., Sargent, R. and Nourbakhsh, I. (2017) Community-empowered air quality monitoring system. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, 6-11 May 2017, pp. 1607–1619. DOI: 10.1145/3025453.3025853
  25. Israel, B. A., Parker, E. A., Rowe, Z., Salvatore, A., Minkler, M., López, J., Butz A. et al. (2005). Community-based participatory research: lessons learned from the Centers for Children’s Environmental Health and Disease Prevention Research. Environmental Health Perspectives, 113(10), pp. 1463–1471. https://pubmed.ncbi.nlm.nih.gov/16203263/; DOI: 10.1289/ehp.7675
  26. Jordan, R.C., Ballard, H.L., and Phillips, T.B. (2012) Key issues and new approaches for evaluating citizen science learning outcomes. Frontiers in Ecology and the Environment, 10(6), pp. 307–309. DOI: 10.1890/110280
  27. Kalkbrenner, B.J. and Roosen, J. (2016) Citizens’ willingness to participate in local renewable energy projects: The role of community and trust in Germany. Energy Research and Social Science, 13, pp. 60–70. DOI: 10.1016/j.erss.2015.12.006
  28. Krippendorff, K. (2004) Reliability in content analysis: Some common misconceptions and recommendations. Human Communication Research, 30(3), pp. 411–433. DOI: 10.1111/j.1468-2958.2004.tb00738.x
  29. Lerner, S. (2010) Sacrifice Zones: The Front Lines of Toxic Chemical Exposure in the United States. Cambridge, MA: MIT Press. DOI: 10.7551/mitpress/8157.001.0001
  30. London, J.K., Haapanen, K.A., Backus, A., Mack, S.M., Lindsey, M. and Andrade, K. (2020). Aligning community-engaged research to context. International Journal of Environmental Research and Public Health, 17(4), p. 1187. DOI: 10.3390/ijerph17041187
  31. Maton, K. I. (2008) Empowering community settings: Agents of individual development, community betterment, and positive social change. American Journal of Community Psychology, 41(1–2), pp. 4–21. DOI: 10.1007/s10464-007-9148-6
  32. McKinley, D.C., Miller-Rushing, A.J., Ballard, H.L., Bonney, R., Brown, H., Cook-Patton, S.C., Evans, D.M. et al. (2017) Citizen science can improve conservation science, natural resource management, and environmental protection. Biological Conservation, 208, pp. 15–28. DOI: 10.1016/j.biocon.2016.05.015
  33. McKinley, D.C., Miller-Rushing, A.J., Ballard, H.L., Bonney, R., Brown, H., French, R.A., Parrish, J.K. et al. (2015) Investing in citizen science can improve natural resource management and environmental protection. Issues in Ecology, 19, pp. 1–27.
  34. McNamara, N., Stevenson, C. and Muldoon, O.T. (2013) Community identity as resource and context: A mixed method investigation of coping and collective action in a disadvantaged community. European Journal of Social Psychology, 43(5), pp. 393–403. DOI: 10.1002/ejsp.1953
  35. National Academies of Sciences, Engineering, and Medicine (2016) Science Literacy: Concepts, Contexts, and Consequences. Washington, DC: The National Academies Press. DOI: 10.17226/23595
  36. National Academies of Sciences, Engineering, and Medicine (2018) Learning through citizen science: Enhancing opportunities by design. Washington, DC: The National Academies Press. DOI: 10.17226/25183
  37. Overdevest, C., Orr, C.H. and Stepenuck, K. (2004) Volunteer stream monitoring and local participation in natural resource issues. Human Ecology Review, 11(2), pp. 177–185.
  38. Pandya, R., Giampoala, M. and Hanson (2021) Science societies launch the community science knowledge exchange forum and the journal Community Science. From the Prow, Washington, D.C.: American Geophysical Union.
  39. Parrish, J. (2022) Searching for community in community science. Community Science, 1(3). DOI: 10.1029/2022CSJ000026.
  40. Peter, M., Diekötter, T., Höffler, T. and Kremer, K. (2021) Biodiversity citizen science: Outcomes for the participating citizens. People and Nature, 3(2), pp. 294–311. DOI: 10.1002/pan3.10193
  41. Phillips, T., Porticella, N., Constas, M. and Bonney, R. (2018) A framework for articulating and measuring individual learning outcomes from participation in citizen science. Citizen Science: Theory and Practice, 3(2), p. 3. DOI: 10.5334/cstp.126
  42. Phillips, T.B., Bonney, R. and Shirk, J. (2012) What is our impact? Toward a unified framework for evaluating impacts of citizen science. In: Dickinson, J.L. and Bonney R. (eds) Eds. Citizen Science: Public Collaboration in Environmental Research. New York: Cornell University Press. pp. 82–96. DOI: 10.7591/cornell/9780801449116.003.0006
  43. Pretty, J. (2003) Social capital and the collective management of resources. Science 302(5652), pp. 1912–1914. DOI: 10.1126/science.1090847
  44. Raheja, G., Harper, L., Hoffman, A., Gorby, Y., Freese, L., O’Leary, B., Deron N. et al. (2022) Community-based participatory research for low-cost air pollution monitoring in the wake of unconventional oil and gas development in the Ohio River Valley: Empowering impacted residents through community science. Environmental Research Letters, 17(6), p. 065006. DOI: 10.1088/1748-9326/ac63f1
  45. Reed, M.S., Evely, A.C., Cundill, G., Fazey, I., Glass, J., Laing, A., Newig, J., et al. (2010) What is social learning? Ecology and Society, 15(4). DOI: 10.5751/es-03564-1504r01
  46. Scott, A.B. and Frost, P.C. (2017) Monitoring water quality in Toronto’s urban stormwater ponds: Assessing participation rates and data quality of water sampling by citizen scientists in the FreshWater Watch. Science of the Total Environment, 592, pp. 738–744. DOI: 10.1016/j.scitotenv.2017.01.201
  47. Shapiro, N., James, J., Barry, B., Crawford, S., Pusatier, J., Henderson, A., Logsdon, et al. (2023) Refining relationships: How an unlikely community–scientist partnership led to a historic environmental justice victory. Environmental Justice, 16(2), pp. 151–161. DOI: 10.1089/env.2022.0018
  48. Shirk, J.L., Ballard, H.L., Wilderman, C.C., Phillips, T., Wiggins, A., Jordan, R., McCallie, et al. (2012) Public participation in scientific research: A framework for deliberate design. Ecology and Society, 17(2). DOI: 10.5751/es-04705-170229
  49. Smith, T.B. and Silva, L. (2011) Ethnic identity and personal well-being of people of color: A meta-analysis. Journal of Counseling Psychology, 58(1), pp. 42–60. DOI: 10.1037/a0021528
  50. Stepenuck, K.F. and Green, L.T. (2015) Individual-and community-level impacts of volunteer environmental monitoring: A synthesis of peer-reviewed literature. Ecology and Society, 20(3). https://www.jstor.org/stable/26270236
  51. Wandersman, A. (2003) Community science: Bridging the gap between science and practice with community-centered models. American Journal of Community Psychology, 31(3–4), pp. 227–242. DOI: 10.1023/a:1023954503247
  52. Wehn, U., Gharesifard, M., Ceccaroni, L., Joyce, H., Ajates, R., Woods, S., Bilbao, A. et al. (2021) Impact assessment of citizen science: state of the art and guiding principles for a consolidated approach. Sustainability Science, 16(5), pp. 1683–1699. DOI: 10.1007/s11625-021-00952-2
  53. Wilderman, C.C. (2007) Models of community science: Design lessons from the field. Citizen Science Toolkit Conference. Ithaca, NY: Cornell Laboratory of Ornithology.
  54. Wilson, S.M. (2009) An ecologic framework to study and address environmental justice and community health issues. Environmental Justice 2(1), pp. 15–24. DOI: 10.1089/env.2008.0515
  55. W.K. Kellogg Foundation (2004) Logic Model Development Guide. Battle Creek, MI: W.K. Kellogg Foundation.
DOI: https://doi.org/10.5334/cstp.1000 | Journal eISSN: 2057-4991
Language: English
Page range: 22 - 22
Submitted on: Feb 13, 2026
Accepted on: Jul 8, 2026
Published on: Aug 14, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services

© 2026 Cathlyn Merritt Davis, Tina Phillips, Veronica Del Bianco, Jenna Linhart, Herizo Andrianandrasana, Clare Cannon, Kimberly Cooke, Jonathan London, Garima Raheja, Mónica Ramírez-Andreotta, Kristine Stepenuck, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.