Have a personal or library account? Click to login
What’s That Frog? Evaluating a Crowdsourced Approach to Species Identification From Audio Recordings Cover

What’s That Frog? Evaluating a Crowdsourced Approach to Species Identification From Audio Recordings

Open Access
|Aug 2024

Figures & Tables

cstp-9-1-688-g1.png
Figure 1

User interface of the FrogID Audio Analysis project on the DigiVol crowdsourcing platform, including a visual oscillogram of the 20–60 second FrogID sound recording, and sample photographs and audio of potential frog species.

Table 1

Accuracy of responses according to the number of frog species calling.

NUMBER OF SPECIES CALLINGCORRECTPARTIALLY CORRECTINCORRECT
Zero (not a frog)69%N/A31%
One69%4%27%
Two35%48%17%
Three24%63%13%
Four12%88%0%
Five4%91%5%
Six2%92%6%
Seven10%60%30%
cstp-9-1-688-g2.png
Figure 2

Histogram of the 28 frog species identified by the expert validators in the FrogID Audio Analysis project, displayed as the percentage of the total number of records of each species which received a correct identification. Red line indicates the overall accuracy of all species combined.

cstp-9-1-688-g3.png
Figure 3

Mean percentage (with 95% confidence interval) of tasks which reach the threshold for retirement according to each consensus threshold and number of volunteer responses.

cstp-9-1-688-g4.png
Figure 4

Mean percentage (with 95% confidence interval) of tasks that reach the threshold for retirement and are identified correctly according to each consensus threshold and number of volunteer responses.

cstp-9-1-688-g5.png
Figure 5

Histogram displaying the number of responses recorded by each individual volunteer, ordered from most to fewest contributions, and indicated by the total percentage of all volunteers. Red line indicates the position of 50% of all responses, which was contributed to by the top 3% of volunteers.

cstp-9-1-688-g6.png
Figure 6

Scatterplot of individual volunteer accuracy according to the number of responses contributed to the audio analysis project, including a regression line derived from a Pearson’s Correlation Test.

cstp-9-1-688-g7.png
Figure 7

Scatterplot of individual volunteer accuracy according to the number of repeat identification sessions (days), including a regression line derived from a Pearson’s Correlation Test.

DOI: https://doi.org/10.5334/cstp.688 | Journal eISSN: 2057-4991
Language: English
Submitted on: Oct 23, 2023
Accepted on: Jul 16, 2024
Published on: Aug 22, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Grace L. Gillard, Paul K. J. Flemons, Nadiah Roslan, Adam Woods, Jodi J. L. Rowley, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.