A Robust, Format-Agnostic Scientific Data Transfer Framework

James Hester

doi:10.5334/dsj-2016-012

Abstract

The olog approach of Spivak and Kent (PLoS ONE 7, 1 (2012) p e24274) is applied to the practical development of data transfer frameworks, yielding simple rules for construction and assessment of data transfer standards. The simplicity, extensibility and modularity of such descriptions allows discipline experts unfamiliar with complex ontological constructs or toolsets to synthesise multiple pre-existing standards, potentially including a variety of file formats, into a single overarching ontology. These ontologies nevertheless capture all scientifically-relevant prior knowledge, and when expressed in machine-readable form are sufficiently expressive to mediate translation between legacy and modern data formats. A format-independent programming interface informed by this ontology consists of six functions, of which only two handle data. Demonstration software implementing this interface is used to translate between two common diffraction image formats using such an ontology in place of an intermediate format.

References

Bernstein H J Classification and use of image data Definition and Exchange of Crystallographic Data, of International Tables for Crystallography 2006 1st ed. G 199 205 10.1107/97809553602060000739
Open DOI Search in Google Scholar Back to article
Bernstein H J Sloan J M Winter G Richter T S Nexus International Advisory Committee and Committee for the Maintenance of the CIF Standard Coping with BIG DATA Image Formats: Integration of CBF, NeXus and HDF5, A Progress Report 2014 Available at: https://sites.google.com/site/nexuscbf/home/presentation-foils/Integration_Poster_10May14_w_overlays.pdf
Search in Google Scholar Back to article
Boulton G Open your minds and share your results Nature 2012 486 7404 441 441 10.1038/486441a
Open DOI Search in Google Scholar Back to article
Gruber T R A translation approach to portable ontology specifications Knowledge Acquisition 1993 5 2 199 220 10.1006/knac.1993.1008
Open DOI Search in Google Scholar Back to article
Hall S McMahon B Definition and exchange of crystallographic data, of International Tables for Crystallography 2005 1st ed. Dordrecht, The Netherlands Springer G
Search in Google Scholar Back to article
Henley S The problem of missing data in geoscience databases Computers & Geosciences 2006 32 9 1368 1377 10.1016/j.cageo.2005.12.008
Open DOI Search in Google Scholar Back to article
Hitzler P Krötzsch M Parsia B Patel-Schneider P Rudolph S OWL 2 Web Ontology Language Primer Tech. rep 2012 W3C Available at: http://www.w3.org/TR/2012/REC-owl2-primer-20121211
Search in Google Scholar Back to article
Könnecke M Akeroyd F A Bernstein H J Brewster A S Campbell S I Clausen B Cottrell S Hoffmann J U Jemian P R Männicke D Osborn R Peterson P F Richter T Suzuki J Watts B Wintersberger E Wuttke J The NeXus data format Journal of Applied Crystallography 2015 48 1 301 305 10.1107/S1600576714027575
Open DOI Search in Google Scholar Back to article
Kroon-Batenburg L M J Helliwell J R Experiences with making diffraction image data available: what metadata do we need to archive? Acta Crystallographica Section D Biological Crystallography 2014 70 10 2502 2509 10.1107/S1399004713029817
Open DOI Search in Google Scholar Back to article
NIAC Nxmx – nexus: Manual 3.1 documentation 2015 Available at: http://download.nexusformat.org/doc/html/classes/applications/NXmx.html
Search in Google Scholar Back to article
Otero-Cerdeira L Rodríguez-Martínez F J Gómez-Rodríguez A Ontology matching: A literature review Expert Systems with Applications 2015 42 2 949 971 10.1016/j.eswa.2014.08.032 Available at: http://www.sciencedirect.com/science/article/pii/S0957417414005144
Open DOI Search in Google Scholar Back to article
Otwinowski Z Minor W Detectors and formats recognised by the HKL/HKL-2000/HKL-3000 software 2016 Available at: http://www.hkl-xray.com/detectors-formats-recognized-hklhkl-2000hkl-3000-software
Search in Google Scholar Back to article
Shvaiko P Euzenat J Ontology matching: State of the art and future challenges IEEE Transactions on Knowledge and Data Engineering 2013 25 1 158 176 10.1109/TKDE.2011.253
Open DOI Search in Google Scholar Back to article
Spadaccini N Castleden I R du Boulay D Hall S R dREL: A relational expression language for dictionary methods Journal of Chemical Information and Modeling 2012 52 8 1917 1925 10.1021/ci300076w
Open DOI Search in Google Scholar Back to article
Spadaccini N Hall S R DDLm: A new dictionary definition language Journal of Chemical Information and Modeling 2012 52 8 1907 1916 10.1021/ci300075z
Open DOI Search in Google Scholar Back to article
Spivak D I Functorial data migration Information and Computation 2012 217 31 51 10.1016/j.ic.2012.05.001
Open DOI Search in Google Scholar Back to article
Spivak D I Category Theory for the Sciences 2014 Cambridge, USA MIT Press 9780262028134 Available at: http://category-theory.mitpress.mit.edu/
Search in Google Scholar Back to article
Spivak D I Kent R E Ologs: A categorical framework for knowledge representation PLoS ONE 2012 7 1 e24274 10.1371/journal.pone.0024274
Open DOI Search in Google Scholar Back to article
Strickland P Hoyland M A McMahon B Automated data validation: Checkcif Definition and Exchange of Crystallographic Data, of International Tables for Crystallography 2005 1st ed. G 561 562
Search in Google Scholar Back to article
The HDF Group Hierarchical data format, version 5 1997–2016 Available at: http://www.hdfgroup.org/HDF5/
Search in Google Scholar Back to article

A Robust, Format-Agnostic Scientific Data Transfer Framework

Abstract

Paradigm

My account