Have a personal or library account? Click to login
What’s That Frog? Evaluating a Crowdsourced Approach to Species Identification From Audio Recordings Cover

What’s That Frog? Evaluating a Crowdsourced Approach to Species Identification From Audio Recordings

Open Access
|Aug 2024

References

  1. 1Adler, F.R., Green, A.M., Sekercioglu, C.H. (2020) Citizen science in ecology: a place for humans in nature. Annals of the New York Academy of Sciences. doi:10.1111/nyas.14340.
  2. 2Bonney, R., Shirk, J.L., Phillips, T.B., Wiggins, A., Ballard, H.L., Miller-Rushing, A.J., Parrish, J.K. (2014) Next steps for citizen science. Science. 343:14361437. doi:10.1126/science.1251554.
  3. 3Bregman, A.S. (1993) Auditory scene analysis: hearing in complex environments. In: McAdams, S. and Bigand E. (eds.) Thinking in Sound: The Cognitive Psychology of Human Audition. Oxford: Oxford Academic. pp. 1036.
  4. 4Bregman, A.S. (1994) Auditory scene analysis: the perpetual organization of sound. MIT Press. doi:10.1121/1.408434.
  5. 5Chandler, M., See, L., Copas, K., Bonde, A.M.Z., Lopez, B., Danielsen, F., Legind, J.K., Masinde, S., Miller-Rushing, A.J., Newman, G., Rosemartin, A., Turak, E. (2017) Contribution of citizen science towards international biodiversity monitoring. Biological Conservation. 213:180194. doi:10.1016/j.biocon.2016.09.004.
  6. 6Davis, L.S., Zhu, L., Finkler, W. (2023) Citizen science: is it good science? Sustainability. 15. doi:10.3390/su15054577.
  7. 7Dickinson, J.L., Shirk, J., Bonter, D., Bonney, R., Crain, R.L., Martin, J., Phillips, T., Purcell, K. (2012) The current state of citizen science as a tool for ecological research and public engagement. Frontiers in Ecology and the Environment. 10(6):291297. doi:10.1890/110236.
  8. 8DigiVol. (2011) Available at https:www.digivol.org. [Last accessed July 27, 2023].
  9. 9Farr, C.M., Ngo, F., Olsen, B. (2023) Evaluating data quality and changes in species identification in a citizen science bird monitoring project. Citizen Science: Theory and Practice. 8(1). doi:10.5334/cstp.604.
  10. 10Genet, K.S., Sargent, L.G. (2003) Evaluation of methods and data quality from a volunteer-based amphibian call survey. Wildlife Society Bulletin. 31(3):703714.
  11. 11Guerrero, M.J., Bedoya, C.L., López, J.D., Daza, J.M., Isaza, C. (2023) Acoustic animal identification using unsupervised learning. Methods in Ecology and Evolution. 14(6):15001514. doi:10.1111/2041-210X.14103.
  12. 12Hines, G., Swanson, A., Kosmala, M., Lintott, C. (2015) Aggregating user input in ecology citizen science projects. In: Proceedings of the Twenty-Seventh Conference on Innovative Applications of Artificial Intelligence, Austin, Texas, 25–30 January 2015.
  13. 13Hsing, P-Y., Bradley, S., Kent, V.T., Hill, R.A., Smith, G.C., Whittingham, M.J., Cokill, J., Crawley, D., MammalWeb volunteers, Stephens, P.A. (2018) Economical crowdsourcing for camera trap image classification. Remote Sensing in Ecology and Conservation. 4(4):361374. doi:10.1002/rse2.84.
  14. 14iNaturalist. (2024) Available from https://www.inaturalist.org. [Last accessed March 11, 2024].
  15. 15Kamar, E., Hacker, S., Horvitz, E. (2012) Combining human and machine learning in large-scale crowdsourcing. In: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems, Valencia, Spain, 4–8 June 2012.
  16. 16Kobori, H., Dickinson, J.L., Washitani, I., Sakurai, R., Amano, T., Komatsu, N., Kitamura, W., Takagawa, S., Koyama, K., Ogawara, T., Miller-Rushing, A.J. (2016) Citizen science: a new approach to advance ecology, education, and conservation. Ecological Research. 31:119. doi:10.1007/s11284-015-1314-y.
  17. 17Kosmala, M., Wiggins, A., Swanson, A., Simmons, B. (2016) Assessing data quality in citizen science. Frontiers in Ecology and the Environment. 14(10):551560. doi:10.1002/fee.1436.
  18. 18Lawson, K.N., Tracy, B.M., Sharova, M., Muirhead, J.R., Cawood, A. (2022) Engaging online citizen scientists and the consensus method to monitor the marine biofouling community. Frontiers in Marine Science. 9. doi:10.3389/fmars.2022.862430.
  19. 19Lukyanenko, R., Parsons, J., Wiersma, Y.F. (2016) Emerging problems of data quality in citizen science. Conservation Biology. 30(3):447449. doi:10.1111/cobi.12706.
  20. 20McKinley, D.C., Miller-Rushing, A.J., Ballard, H.L., Bonney, R., Brown, H., Cook-Patton, S.C., Evans, D.M., French, R.A., Parrish, J.K., Phillips, T.B., Ryan, S.F., Shanely, L.A., Shrik, J.L., Stepenuck, K.F., Weltzin, J.F., Wiggins, A., Boyle, O.D., Briggs, R.D., Chapin, III S.F., Hewitt, D.A., Preuss, P.W., Soukup, M.A. (2017) Citizen science can improve conservation science, natural reitalic management, and environmental protection. Biological Conservation. 208:1528. doi:10.1016/j.biocon.2016.05.015.
  21. 21Mugford, J., Moltchanova, E., Plank, M., Sullivan, J., Byrom, A., James, A. (2021) Citizen science decisions: A Bayesian approach optimises effort. Ecological Informatics. 63. doi:10.1016/j.ecoinf.2021.101313.
  22. 22Obrist, M.K., Pavan, G., Sueur, J., Riede, K., Llusia, D., Márquez, R. (2010) Bioacoustics approaches in biodiversity inventories. Abc Taxa. 8:6899.
  23. 23Penar, W., Magiera, A., Klocek, C. (2020) Applications of bioacoustics in animal ecology. Ecological Complexity. 43. doi:10.1016/j.ecocom.2020.100847.
  24. 24QuestaGame. (2023) Available at: questagame.com. [Last accessed July 27, 2023]
  25. 25Raddick, M.J., Bracey, G., Gay, P.L., Lintott, C.J., Cardamone, C., Murray, P., Schawinski, K., Szalay, A.S., Vandenberg, J. (2013) Galaxy Zoo: Motivations of citizen scientists. Astronomy Education Review. 12(1). doi:10.3847/AER2011021.
  26. 26Rahmanian, B., Davis, J.G. (2014) User interface design for crowdsourcing systems. In: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, Como, Italy, May 2014, pp.405408.
  27. 27Ratnieks, F.L.W., Schrell, F., Sheppard, R.C., Brown, E., Bristow, O.E., Garbuzov, M. (2016) Data reliability in citizen science: learning curve and the effects of training method, volunteer background and experience on identification accuracy of insects visiting ivy flowers. Methods in Ecology and Evolution. 7:12261235. doi:10.1111/2041-210X.12581.
  28. 28Riesch, H., Potter, C. (2013) Citizen science as seen by scientists: Methodological, epistemological and ethical dimensions. Public Understanding of Science. 23(1):107120. doi:10.1177/0963662513497324.
  29. 29Rowley, J.J.L., Callaghan, C.T. (2022) Tracking the spread of the eastern dwarf tree frog (Litoria fallax) in Australia using citizen science. Australian Journal of Zoology. 70(6):204210. doi:10.1071/ZO23012.
  30. 30Rowley, J.J.L., Callaghan, C.T., Cutajar, T., Portway, C., Potter, K., Mahony, S., Trembath, D.F., Flemons, P., Woods, A. (2019) FrogID: Citizen scientists provide validated biodiversity data on frogs of Australia. Herpetological Conservation and Biology. 14(1):155170.
  31. 31Salome-Diaz, J., Golubov, J., Diaz-Segura, O., Ramirez-Gutierrez, M.A., Sifuentes de la Torre, S., Koleff, P., Quintero, E., Martinez, A.J. (2023) Practice makes the expert: the importance of training volunteers in the generation of phenological data from photographs of biodiversity observation platforms. PLoS ONE. 18(3). doi:10.1371/journal.pone.0282750.
  32. 32Santos-Fernandez, E., Mengersen, K. (2021) Understanding the reliability of citizen science observational data using item response models. Methods in Ecology and Evolution. 12:15331548. doi:10.1111/2041-210X.13623.
  33. 33Santos-Fernandez, E., Vercelloni, J., Price, A., Heron, G., Christensen, B., Peterson, E.E., Mengersen, K. (2023) Increasing trust in new data italics: crowdsourcing image classification for ecology. International Statistical Review. doi:10.1111/insr.12542.
  34. 34Sharma, N., Colucci-Gray, L., Siddharthan, A., Comont, R., van der Wal, R. (2019) Designing online species identification tools for biological recording: the impact on data quality and citizen science learning. PeerJ. 6. doi:10.7717/peerj.5965.
  35. 35Sharma, N., Colucci-Gray, L., van der Wal, R., Siddharthan, A. (2022) Consensus building in on-line citizen science. Proceedings of the ACM on Human-Computer Interaction. 6. doi:10.1145/3555535.
  36. 36Siddharthan, A., Lambin, C., Robinson, A-M., Sharma, N., Comont, R., O’Mahony, E., Mellish, C., van der Wal, R. (2016) Crowdsourcing without a crowd: reliable online species identification using Bayesian models to minimize crowd size. ACM Transactions on Intelligent Systems and Technology. 7(4). doi:10.1145/2776896.
  37. 37Silvertown, J., Greenwood, H.M., Dodd, M., Rosewell, J., Rebelo, T., Ansine, J., McConway, K. (2015) Crowdsourcing the identification of organisms: a case-study of iSpot. ZooKeys. 480:125146. doi:10.3897/zookeys.480.8803.
  38. 38Swanson, A., Kosmala, M., Lintott, C., Packer, C. (2016) A generalized approach for producing, quantifying, and validating citizen science data from wildlife images. Conservation Biology. 30(3):520531. doi:10.1111/cobi/12695.
  39. 39Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., Packer, C. (2015) Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savanna. Scientific Data 2. doi:10.1038/sdata.2015.26.
  40. 40Thompson, M.M., Moon, K., Woods, A., Rowley, J.J.L., Poore, A.G.B., Kingsford, R.T., Callaghan, C.T. (2023) Citizen science participant motivations and behaviour: Implications for biodiversity data coverage. Biological Conservation. 282. doi:10.1016/j.biocon.2023.110079.
  41. 41van der Wal, R., Sharma, N., Mellish, C., Robinson, A., Siddharthan, A. (2016) The role of automated feedback in training and retaining biological recorders for citizen science. Conservation Biology. 30(3):550561. doi:10.1111/cobi.12705.
  42. 42Westphal, A.M., Breiter, C-J.C., Falconer, S., Saffar, N., Ashraf, A.B., McCall, A.G., McIver, K., Petersen, S.D. (2022) Citizen science and machine learning: interdisciplinary approach to non-invasively monitoring a northern marine ecosystem. Frontiers in Marine Science. 9. doi:10.3389/fmars.2022.961095.
  43. 43Zooniverse. (2024) Available from https://www.zooniverse.org. [Last accessed March 11, 2024].
DOI: https://doi.org/10.5334/cstp.688 | Journal eISSN: 2057-4991
Language: English
Submitted on: Oct 23, 2023
Accepted on: Jul 16, 2024
Published on: Aug 22, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Grace L. Gillard, Paul K. J. Flemons, Nadiah Roslan, Adam Woods, Jodi J. L. Rowley, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.