Have a personal or library account? Click to login
A Successful Crowdsourcing Approach for Bird Sound Classification Cover

A Successful Crowdsourcing Approach for Bird Sound Classification

Open Access
|Apr 2023

Figures & Tables

cstp-8-1-556-g1.png
Figure 1

A view of the web portal section “Declare your level of expertise.”

cstp-8-1-556-g2.png
Figure 2

A view of the web portal section “Identify letters” (note that templates were called letters in the web portal).

cstp-8-1-556-g3.png
Figure 3

A view of the web portal section “Identify recordings.”

cstp-8-1-556-g4.png
Figure 4

A view of the web portal section “Results,” which presents the number of all classifications made in the portal as well as those made by the user themselves and other users who have approved public visibility of their names. The results also show how well the users’ classifications (identifications in the portal) correspond to the classifications of other users of the same recordings given at species level, and, they show a species-specific recognizability, which is the average proportion of unanimous classifications by candidates among all users.

cstp-8-1-556-g5.png
Figure 5

The number of daily page views on the web portal over time. Dates and types of advertisements are expressed as point shapes on top of the daily page views.

cstp-8-1-556-g6.png
Figure 6

The numbers of classifications by the participating users arranged in descending order from left to right (black dots) and their accumulation curves (grey squares) for (a) the sets of candidates for templates and (b) the 10-second clips. In total, 203 users contributed to candidate classification (a), whereas 43 users also classified clips (b).

cstp-8-1-556-g7.png
Figure 7

Variation among users in their quality of classifications. The plot shows the relation between users’ accuracy in candidates and clips. For candidates, the accuracy score was calculated as the proportion of candidates for which the user’s classification matched the rounded majority vote of the letter. For clips, the accuracy score was calculated by taking the mean of precision (proportion of user’s all-positive votes that were correct according to the majority vote) and recall score (proportion of user’s positive classifications among all species that were present in the recordings). The self-evaluation of the user’s expertise is indicated by the symbol type, and the size of the symbol indicates the number of classifications made by the user (varied from 409 to 31,895 including both candidates and clips).

DOI: https://doi.org/10.5334/cstp.556 | Journal eISSN: 2057-4991
Language: English
Submitted on: Aug 25, 2022
Accepted on: Mar 7, 2023
Published on: Apr 11, 2023
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2023 Petteri Lehikoinen, Meeri Rannisto, Ulisses Camargo, Aki Aintila, Patrik Lauha, Esko Piirainen, Panu Somervuo, Otso Ovaskainen, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.