Have a personal or library account? Click to login
The Verification of Ecological Citizen Science Data: Current Approaches and Future Possibilities Cover

The Verification of Ecological Citizen Science Data: Current Approaches and Future Possibilities

Open Access
|Apr 2021

References

  1. August, T, Fox, R, Roy, DB and Pocock, MJO. 2020. Data-derived metrics describing the behaviour of field-based citizen scientists provide insights for project design and modelling bias. Scientific Reports, 10(1): 11009. DOI: 10.1038/s41598-020-67658-3
  2. Barton, K. 2020. MuMIn: Multi-Model Inference. R package version 1.43.17. https://CRAN.R-project.org/package=MuMIn.
  3. Bates, AJ, Lakeman Fraser, P, Robinson, L, Tweddle, JC, Sadler, JP, West, SE, Norman, S, Batson, M and Davies, L. 2015. The OPAL bugs count survey: exploring the effects of urbanisation and habitat characteristics using citizen science. Urban Ecosystems, 18(4): 14771497. DOI: 10.1007/s11252-015-0470-8
  4. Bone, J, Archer, M, Barraclough, D, Eggleton, P, Flight, D, Head, M, Jones, DT, Scheib, C and Voulvoulis, N. 2012. Public participation in soil surveys: Lessons from a pilot study in England. Environmental Science and Technology, 46(7): 36873696. DOI: 10.1021/es203880p
  5. Bonter, DN and Cooper, CB. 2012. Data validation in citizen science: a case study from Project FeederWatch. Frontiers in Ecology and the Environment, 10(6): 305307. DOI: 10.1890/110273
  6. Borden, KA, Kapadia, A, Smith, A and Whyte, L. 2013. Educational Exploration of the Zooniverse: Tools for Formal and Informal Audience Engagement. ASP Conference Series, 473: 101107.
  7. Chase, SK and Levine, A. 2016. A framework for evaluating and designing citizen science programs for natural resources monitoring. Conservation Biology, 30(3): 456466. DOI: 10.1111/cobi.12697
  8. Collaboration for Environmental Evidence. 2018. Guidelines and Standards for Evidence synthesis in Environmental Management. Version 5.0 (Pullin, AS, Frampton, GK, Livoreil, B and Petrokofsky, G, Eds). Available at: http://www.environmentalevidence.org/information-for-authors (Last accessed: 2 January 2020).
  9. Crall, AW, Newman, GJ, Stohlgren, TJ, Holfelder, KA, Graham, J and Waller, DM. 2011. Assessing citizen science data quality: an invasive species case study. Conservation Letters, 4(6): 433442. DOI: 10.1111/j.1755-263X.2011.00196.x
  10. Dennis, EB, Morgan, BJT, Freeman, SN, Brereton, TM and Roy, DB. 2016. A generalized abundance index for seasonal invertebrates. Biometrics, 72(4): 13051314. DOI: 10.1111/biom.12506
  11. Devictor, V, Whittaker, RJ and Beltrame, C. 2010. Beyond scarcity: citizen science programmes as useful tools for conservation biogeography. Diversity and Distributions, 16(3): 354362. DOI: 10.1111/j.1472-4642.2009.00615.x
  12. Dickinson, JL, Zuckerberg, B and Bonter, DN. 2010. Citizen Science as an Ecological Research Tool: Challenges and Benefits. Annual Review of Ecology, Evolution, and Systematics, 41(1): 149172. DOI: 10.1146/annurev-ecolsys-102209-144636
  13. Donnelly, A, Crowe, O, Regan, E, Begley, S and Caffarra, A. 2014. The role of citizen science in monitoring biodiversity in Ireland. International Journal of Biometeorology, 58(6): 12371249. DOI: 10.1007/s00484-013-0717-0
  14. Flaherty, M and Lawton, C. 2019. The regional demise of a non-native invasive species: the decline of grey squirrels in Ireland. Biological Invasions, 21(7): 24012416. DOI: 10.1007/s10530-019-01987-x
  15. Flower, E, Jones, D and Bernede, L. 2016. Can Citizen Science Assist in Determining Koala (Phascolarctos Cinereus) Presence in a Declining Population? Animals, 6(7): 42. DOI: 10.3390/ani6070042
  16. Gardner, E. 2019. Make the Adder Count: population trends from a citizen science survey of UK adders. Herpetological Journal, 29(1): 5770. DOI: 10.33256/hj29.1.5770
  17. Gilfedder, M, Robinson, CJ, Watson, JEM, Campbell, TG, Sullivan, BL and Possingham, HP. 2019. Brokering Trust in Citizen Science. Society and Natural Resources, 32(3): 292302. DOI: 10.1080/08941920.2018.1518507
  18. Green, SE, Rees, JP, Stephens, PA, Hill, RA and Giordano, AJ. 2020. Innovations in Camera Trapping Technology and Approaches: The Integration of Citizen Science and Artificial Intelligence. Animals, 10(1): 132. DOI: 10.3390/ani10010132
  19. Hof, AR and Bright, PW. 2016. Quantifying the long-term decline of the West European hedgehog in England by subsampling citizen-science datasets. European Journal of Wildlife Research, 62(4): 407413. DOI: 10.1007/s10344-016-1013-1
  20. Hsing, P, Bradley, S, Kent, VT, Hill, RA, Smith, GC, Whittingham, MJ, Cokill, J, Crawley, D, MammalWeb Volunteers and Stephens, PA. 2018. Economical crowdsourcing for camera trap image classification. Remote Sensing in Ecology and Conservation, 4(4): 361374. DOI: 10.1002/rse2.84
  21. Huber, B, Barnidge, M, Gil de Zúñiga, H and Liu, J. 2019. Fostering public trust in science: The role of social media. Public understanding of science (Bristol, England), 28(7): 759777. DOI: 10.1177/0963662519869097
  22. Isaac, NJB, van Strien, AJ, August, TA, de Zeeuw, MP and Roy, DB. 2014. Statistics for citizen science: extracting signals of change from noisy ecological data. Methods in Ecology and Evolution, 5(10): 10521060. DOI: 10.1111/2041-210X.12254
  23. Iyengar, S and Massey, DS. 2019. Scientific communication in a post-truth society. Proceedings of the National Academy of Sciences of the United States of America, 116(16): 76567661. DOI: 10.1073/pnas.1805868115
  24. Jones, FM, Allen, C, Arteta, C, Arthur, J, Black, C, Emmerson, LM, Freeman, R, Hines, G, Lintott, CJ, Macháčková, Z, Miller, G, Simpson, R, Southwell, C, Torsey, HR, Zisserman, A and Hart, T. 2018. Time-lapse imagery and volunteer classifications from the Zooniverse Penguin Watch project. Scientific Data, 5(1): 180124. DOI: 10.1038/sdata.2018.124
  25. Kabat, AP, Scott, R, Kabat, TJ and Barrett, G. 2012. 2011 Great Cocky Count: Population estimates and identification of roost sites for the Carnaby’s Cockatoo (Calyptorhynchus latirostris). Perth WA.
  26. Kamp, J, Oppel, S, Heldbjerg, H, Nyegaard, T and Donald, PF. 2016. Unstructured citizen science data fail to detect long-term population declines of common birds in Denmark. Diversity and Distributions, 22(10): 10241035. DOI: 10.1111/ddi.12463
  27. Kelling, S, Yu, J, Gerbracht, J and Wong, WK. 2011. Emergent filters: Automated data verification in a large-scale citizen science project. Proceedings – 7th IEEE International Conference on e-Science Workshops, eScienceW 2011. IEEE, Stockholm on 5–8 December 2011, 2027. DOI: 10.1109/eScienceW.2011.13
  28. Kimura, AH and Kinchy, A. 2016. Citizen Science: Probing the Virtues and Contexts of Participatory Research. Engaging Science, Technology, and Society, 2: 331. DOI: 10.17351/ests2016.99
  29. Kosmala, M, Crall, A, Cheng, R, Hufkens, K, Henderson, S and Richardson, A. 2016b. Season Spotter: Using Citizen Science to Validate and Scale Plant Phenology from Near-Surface Remote Sensing. Remote Sensing, 8(9): 726. DOI: 10.3390/rs8090726
  30. Kosmala, M, Wiggins, A, Swanson, A and Simmons, B. 2016a. Assessing data quality in citizen science, Frontiers in Ecology and the Environment, 14(10): 551560. DOI: 10.1002/fee.1436
  31. Kullenberg, C and Kasperowski, D. 2016. What Is Citizen Science? – A Scientometric Meta-Analysis. PLOS ONE, 11(1): e0147152. DOI: 10.1371/journal.pone.0147152
  32. Křeček, J, Palán, L, Pažourková, E and Stuchlík, E. 2019. Water-quality genesis in a mountain catchment affected by acidification and forestry practices. Freshwater Science, 38(2): 257269. DOI: 10.1086/698533
  33. Lagoze, C. 2014. eBird: Curating Citizen Science Data for Use by Diverse Communities. International Journal of Digital Curation, 9(1): 7182. DOI: 10.2218/ijdc.v9i1.302
  34. Lyon, JP, Bird, TJ, Kearns, J, Nicol, S, Tonkin, Z, Todd, CR, O’Mahony, J, Hackett, G, Raymond, S, Lieschke, J, Kitchingman, A and Bradshaw, CJA. 2019. Increased population size of fish in a lowland river following restoration of structural habitat. Ecological Applications, 29(4): e01882. DOI: 10.1002/eap.1882
  35. Mason, CE and Garbarino, J. 2016. The Power of Engaging Citizen Scientists for Scientific Progress. Journal of Microbiology & Biology Education, 17(1): 712. DOI: 10.1128/jmbe.v17i1.1052
  36. McBride, MF, Fidler, F and Burgman, MA. 2012. Evaluating the accuracy and calibration of expert predictions under uncertainty: predicting the outcomes of ecological research. Diversity and Distributions, 18(8): 782794. DOI: 10.1111/j.1472-4642.2012.00884.x
  37. Meehan, TD, Michel, NL and Rue, H. 2019. Spatial modeling of Audubon Christmas Bird Counts reveals fine-scale patterns and drivers of relative abundance trends. Ecosphere, 10(4): e02707. DOI: 10.1002/ecs2.2707
  38. Miller-Rushing, A, Primack, R and Bonney, R. 2012. The history of public participation in ecological research. Frontiers in Ecology and the Environment, 10(6): 285290. DOI: 10.1890/110278
  39. National Coordinating Centre for Public Engagement (NCCPE). 2016. Examples of successful public engagement : additional evidence submitted to the Science and Technology Committee (Science Communication) by the National Coordinating Centre for Public Engagement.
  40. Newman, G, Wiggins, A, Crall, A, Graham, E, Newman, S and Crowston, K. 2012. The future of citizen science: emerging technologies and shifting paradigms. Frontiers in Ecology and the Environment, 10(6): 298304. DOI: 10.1890/110294
  41. Pace, ML, Hampton, SE, Limburg, KE, Bennett, EM, Cook, EM, Davis, AE, Grove, JM, Kaneshiro, KY, LaDeau, SL, Likens, GE, McKnight, DM, Richardson, DC and Strayer, DL. 2010. Communicating with the public: opportunities and rewards for individual ecologists. Frontiers in Ecology and the Environment, 8(6): 292298. DOI: 10.1890/090168
  42. Pescott, OL, Walker, KJ, Pocock, MJO, Jitlal, M, Outhwaite, CL, Cheffings, CM, Harris, F and Roy, DB. 2015. Ecological monitoring with citizen science: the design and implementation of schemes for recording plants in Britain and Ireland. Biological Journal of the Linnean Society, 115(3): 505521. DOI: 10.1111/bij.12581
  43. Pocock, MJO, Chapman, DS, Sheppard, LJ and Roy, HE. 2014. Choosing and using citizen science: a guide to when and how to use citizen science to monitor biodiversity and the environment – NERC Open Research Archive. Centre for Ecology and Hydrology, Wallingford.
  44. Pocock, MJO, Roy, HE, Preston, CD and Roy, DB. 2015. The Biological Records Centre: a pioneer of citizen science. Biological Journal of the Linnean Society, 115(3): 475493. DOI: 10.1111/bij.12548
  45. Pocock, MJO, Tweddle, JC, Savage, J, Robinson, LD and Roy, HE. 2017. The diversity and evolution of ecological and environmental citizen science. PLOS ONE, 12(4): e0172579. DOI: 10.1371/journal.pone.0172579
  46. Pusceddu, M, Floris, I, Mannu, R, Cocco, A and Satta, A. 2019. Using verified citizen science as a tool for monitoring the European hornet (Vespa crabro) in the island of Sardinia (Italy). NeoBiota, 50: 97108. DOI: 10.3897/neobiota.50.37587
  47. Rotman, D, Hammock, J, Preece, J, Hansen, D, Boston, C, Bowser, A and He, Y. 2014. Motivations Affecting Initial and Long-Term Participation in Citizen Science Projects in Three Countries. iConference 2014 Proceedings, 110124. DOI: 10.9776/14054
  48. Roy, DB and Sparks, TH. 2000. Phenology of British butterflies and climate change. Global Change Biology, 6(4), 407416. DOI: 10.1046/j.1365-2486.2000.00322.x
  49. Roy, HE, Pocock, MJO, Preston, CD, Roy, DB, Savage, J, Tweddle, JC and Robinson, LD. 2012. Understanding citizen science and environmental monitoring: final report on behalf of UK Environmental Observation Framework. NERC/Centre for Ecology & Hydrology, Wallingford.
  50. Salomon, AK, Lertzman, K, Brown, K, Wilson, ḴB, Secord, D and McKechnie, I. 2018. Democratizing conservation science and practice. Ecology and Society. DOI: 10.5751/ES-09980-230144
  51. Sewell, D, Beebee, TJC and Griffiths, RA. 2010. Optimising biodiversity assessments by volunteers: The application of occupancy modelling to large-scale amphibian surveys. Biological Conservation, 143(9): 21022110. DOI: 10.1016/j.biocon.2010.05.019
  52. Siddharthan, A, Lambin, C, Robinson, AM, Sharma, N, Comont, R, O’mahony, E, Mellish, C and Van Der Wal, R. 2016. Crowdsourcing without a crowd: Reliable online species identification using Bayesian models to minimize crowd size. ACM Transactions on Intelligent Systems and Technology, 7(4). DOI: 10.1145/2776896
  53. Silvertown, J. 2009. A new dawn for citizen science. Trends in Ecology & Evolution, 24(9): 467471. DOI: 10.1016/j.tree.2009.03.017
  54. Silvertown, J, Harvey, M, Greenwood, R, Dodd, M, Rosewell, J, Rebelo, T, Ansine, J and McConway, K. 2015. Crowdsourcing the identification of organisms: A case-study of iSpot. ZooKeys, 480(480): 125146. DOI: 10.3897/zookeys.480.8803
  55. Smale, DA, Epstein, G, Parry, M and Attrill, MJ. 2019. Spatiotemporal variability in the structure of seagrass meadows and associated macrofaunal assemblages in southwest England (UK): Using citizen science to benchmark ecological pattern. Ecology and Evolution, 9(7): 39583972. DOI: 10.1002/ece3.5025
  56. Sutherland, WJ, Roy, DB and Amano, T. 2015. An agenda for the future of biological recording for ecological monitoring and citizen science. Biological Journal of the Linnean Society, 115(3): 779784. DOI: 10.1111/bij.12576
  57. Swanson, A, Kosmala, M, Lintott, C and Packer, C. 2016. A generalized approach for producing, quantifying, and validating citizen science data from wildlife images. Conservation Biology, 30(3): 520531. DOI: 10.1111/cobi.12695
  58. Swanson, A, Kosmala, M, Lintott, C, Simpson, R, Smith, A and Packer, C. 2015. Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savanna. Scientific Data, 2(1). DOI: 10.1038/sdata.2015.26
  59. Terry, JCD, Roy, HE and August, TA. 2020. Thinking like a naturalist: Enhancing computer vision of citizen science images by harnessing contextual data. Methods in Ecology and Evolution, 11(2), 303315. DOI: 10.1111/2041-210X.13335
  60. Torney, CJ, Lloyd-Jones, DJ, Chevallier, M, Moyer, DC, Maliti, HT, Mwita, M, Kohi, EM and Hopcraft, GC. 2019. A comparison of deep learning and citizen science techniques for counting wildlife in aerial survey images. Methods in Ecology and Evolution, 10(6): 779787. DOI: 10.1111/2041-210X.13165
  61. Tweddle, JC, Robinson, D, Pocock, MJO and Roy, HE. 2012. Guide to citizen science: developing, implementing and evaluating citizen science to study biodiversity and the environment in the UK – NERC Open Research Archive. Wallingford: Centre for Ecology and Hydrology.
  62. van der Wal, R, Sharma, N, Mellish, C, Robinson, A and Siddharthan, A. 2016. The role of automated feedback in training and retaining biological recorders for citizen science. Conservation Biology, 30(3): 550561. DOI: 10.1111/cobi.12705
  63. Venables, WN and Ripley, BD. 2002. Modern Applied Statistics with S. Fourth Edition. New York: Springer. ISBN 0-387-95457-0. DOI: 10.1007/978-0-387-21706-2_14
  64. Waetjen, DP and Shilling, FM. 2017. Large Extent Volunteer Roadkill and Wildlife Observation Systems as Sources of Reliable Data. Frontiers in Ecology and Evolution, 5(89). DOI: 10.3389/fevo.2017.00089
  65. Wehrmann, J, de Boer, F, Benjumea, R, Cavaillès, S, Engelen, D, Jansen, J, Verhelst, B and Vansteelant, WMG. 2019. Batumi Raptor Count: autumn raptor migration count data from the Batumi bottleneck, Republic of Georgia. ZooKeys, 836, 135157. DOI: 10.3897/zookeys.836.29252
  66. West, P. 2012. FeralScan: web-based community reporting, education and extension tool for landholders and community groups. Orange NSW.
  67. Wiggins, A, Newman, G, Stevenson, RD and Crowston, K. 2011. Mechanisms for data quality and validation in citizen science. Proceedings – 7th IEEE International Conference on e-Science Workshops, eScienceW 2011, Stockholm on 5–8 December 2011, 1419. DOI: 10.1109/eScienceW.2011.27
  68. Woolley, JP, McGowan, ML, Teare, HJA, Coathup, V, Fishman, JR, Settersten, RA, Sterckx, S, Kaye, J and Juengst, ET. 2016. Citizen science or scientific citizenship? Disentangling the uses of public engagement rhetoric in national research initiatives. BMC Medical Ethics, 17(1). DOI: 10.1186/s12910-016-0117-1
  69. Yu, J, Kelling, S, Gerbracht, J and Wong, WK. 2012. Automated data verification in a large-scale citizen science project: A case study. 2012 IEEE 8th International Conference on E-Science, e-Science 2012. Chicago, IL on 8–12 October 2012. DOI: 10.1109/eScience.2012.6404472
  70. Yu, J, Wong, WK and Hutchinson, RA. 2010. Modeling Experts and Novices in Citizen Science Data for Species Distribution Modeling. IEEE, Sydney, NSW on 13–17 Deceber 2010, 11571162. DOI: 10.1109/ICDM.2010.103
DOI: https://doi.org/10.5334/cstp.351 | Journal eISSN: 2057-4991
Language: English
Submitted on: Jul 24, 2020
|
Accepted on: Feb 12, 2021
|
Published on: Apr 13, 2021
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2021 Emily Baker, Jonathan P. Drury, Johanna Judge, David B. Roy, Graham C. Smith, Philip A. Stephens, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.