Have a personal or library account? Click to login
The FAIR Assessment Conundrum: Reflections on Tools and Metrics Cover

The FAIR Assessment Conundrum: Reflections on Tools and Metrics

Open Access
|May 2024

Figures & Tables

Table 1

List of FAIR assessment tools analysed.

Table 2

Differentiation of analysed tools based on identified distinguishing characteristics. The term ‘enabled’ signifies that the configuration allows the addition of new metrics, allowing individuals to include metrics relevant to their discipline or community. The ‘any dig. obj.*’ value means that there is a large number of typologies supported yet this is specialised rather than actually supporting ‘any’.

TOOL IDTARGETMETHODOLOGYADAPTABILITYDISCIPLINE SPECIFICCOMMUNITY SPECIFICPROVISIONING
AUTany dig. obj.*automaticnobioinformaticsnoas-a-service
CHEany dig. obj.automaticnolife sciencesnoas-a-service
DATdatasetmanualnononoas-a-service
ENOdatasetautomaticyesenabledenabledas-a-service
EVAdatasetautomaticnonoyesas-a-service
EVLany dig. obj.automaticyesenabledenabledas-a-service
FDBdatasetmanualnononoas-a-service
FESrepositorymanualnononoon-premises
FOOsemantic artefactautomaticnononoas-a-service
FROany dig. obj.*automaticnononoon-premises
FSHany dig. obj.hybridyesenabledenabledas-a-service
FUJdatasetautomaticnononoas-a-service
HFIsoftwareautomaticnononoon-premises
MATrepositoryhybridnoyesnoon-premises
OFAsemantic artefactautomaticnononoas-a-service
OPErepositoryautomaticnonoyesas-a-service
RDAdatasetmanualnononoon-premises
SAGdatasetmanualnononoon-premises
SATdatasetmanualnonoyesas-a-service
SETdatasetmanualnononoas-a-service
dsj-23-1650-g1.png
Figure 1

FAIR assessment tools trends.

dsj-23-1650-g2.png
Figure 2

FAIR assessment tools’ declared metric intent distribution. In the left diagram, F, A, I, and R series refer to metrics with declared intent Findable, Accessible, Interoperable, and Reusable rather than a numbered/specific principle. The ‘n/a’ series is for metrics that do not declare an intent referring to a specific principle or even to a letter of the FAIR acronym. In the right diagram, the metrics are aggregated by class of principles, e.g. the F-related metrics include all the ones that in the left diagram are either F, F1, F2, F3 or F4.

dsj-23-1650-g3.png
Figure 3

FAIR assessment tools’ observed metric goal distribution. In the left diagram, metrics are associated either with a specific principle, ‘many’ principles or ‘none’ principle. In the right diagram, the metrics associated with a specific principle are aggregated by class of principles, e.g. the R-related metrics include all the ones that in the left diagram are either F1, F2, F3 or F4.

dsj-23-1650-g4.png
Figure 4

Comparison of the metrics distributions with regard to their declared and observed intent.

dsj-23-1650-g5.png
Figure 5

Co-occurrences among metrics observed FAIR principles in numbers and percentages.

dsj-23-1650-g6.png
Figure 6

Discrepancies among metrics declared and observed FAIR principles in numbers and percentages.

dsj-23-1650-g7.png
Figure 7

Technology types per declared metric intent.

Language: English
Submitted on: Nov 8, 2023
|
Accepted on: Apr 24, 2024
|
Published on: May 27, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Leonardo Candela, Dario Mangione, Gina Pavone, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.