The Norwegian National Ground Segment; Preservation, Distribution and Exploitation of Sentinel Data

Trygve Halsne; Lara Ferrighi; Bard Saadatnejad; Nico Budewitz; Frode Dinessen; Lars-Anders Breivik; Øystein Godøy

doi:10.5334/dsj-2019-061

Abstract

In order to take advantage of the Sentinel program, the Norwegian Space Agency decided to establish a national collaborative ground segment for satellite data with the purpose of simplifying data access, ensure support for operational national services and long term preservation of data. This is the NBS where MET Norway has the technical responsibility in terms of providing the infrastructure and storage capacity for data management. Serving the data through two separate platforms, the end users have access to the data in its original format in addition to Sentinel-1 and Sentinel-2 products in NetCDF-4/CF. Using the latter format, services like regridding, subsetting, visualization and aggregation are integrated utilizing OPeNDAP in combination with OGC WMS and OGC WPS. In addition, data uploading and retrieving operations are simplified for an end user since streaming of data by means of OPeNDAP is supported in multiple programming languages. Due to the strong coupling between space based earth observations, in-situ observation, model data etc, disseminating data in a generic data management system utilizing NetCDF-4/CF and OPeNDAP is convenient for seamless integration across branches. However, the current CF version is not mature for handling all parts of the Sentinel data but future development looks very promising.

References

Balasubramonian, R and Grot, B. 2016. Near-data processing. IEEE Micro, 4–5. DOI: 10.1109/MM.2016.1
Open DOI Search in Google Scholar Back to article
Brian, E, Jonathan, G, Bob, D, Karl, T, Steve, H, Jon, B, John, C, Rich, S, Phil, B, Greg, R, Heinke H, Alison, P, Martin, J and Martin, R. NetCDF Climate and Forecast (CF) Metadata Conventions. Available at http://cfconventions.org [Last accessed 16 11 2019].
Search in Google Scholar Back to article
Cinquini, L, Crichton, D, Mattmann, C, Harney, J, Shipman, G, Wang, F, Ananthakrishnan, R, Miller, N, Denvil, S, Morgan, M, Pobre, Z, Bell, GM, Doutriaux, C, Drach, R, Williams, D, Kershaw, P, Pascoe, S, Gonzalez, E, Fiore, S and Schweitzer, R. 2014. The Earth System Grid Federation: An open infrastructure for access to distributed geospatial data. Future Generation Computer Systems, 36: 400–417. DOI: 10.1016/j.future.2013.07.002
Open DOI Search in Google Scholar Back to article
Cristóbal, J, Ninyerola, M and Pons, X. 2008. Modeling air temperature through a combination of remote sensing and GIS data. Journal of Geophysical Research, 113. DOI: 10.1029/2007JD009318
Open DOI Search in Google Scholar Back to article
Dierking, W. 2013. Sea Ice Monitoring by Synthetic Aperture Radar. Oceanography, 26. DOI: 10.5670/oceanog.2013.33
Open DOI Search in Google Scholar Back to article
Dwyer, JL, Roy, DP, Sauer, B, Jenkerson, CB, Zhang, HK and Lymburner, L. 2018. Analysis Ready Data: Enabling Analysis of the Landsat Archive. Remote Sensing, 10. DOI: 10.20944/preprints201808.0029.v1
Open DOI Search in Google Scholar Back to article
ESA. 2017. Accessing Copernicus Data Made Easier. Available at https://www.esa.int/Our_Activities/Observing_the_Earth/Copernicus/Accessing_Copernicus_data_made_easier [Last accessed 16 01 2019].
Search in Google Scholar Back to article
Fielding, RT and Taylor, RN. 2000. Architectural styles and the design of network-based software architectures. Irvine, USA: University of California.
Search in Google Scholar Back to article
Folk, M, Heber, G, Koziol, Q, Pourmal, E and Robinson, D. 2011. An Overview of the HDF5 Technology Suite and Its Applications. Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases, 36–47. DOI: 10.1145/1966895.1966900
Open DOI Search in Google Scholar Back to article
Gjevik, B, Moe, H and Ommundsen, A. 1997. Sources of the Maelstrom. Nature, 388: 837–838. DOI: 10.1038/42159
Open DOI Search in Google Scholar Back to article
Gorelick, N, Hancher, M, Dixon, M, Ilyushchenko, S, Thau, D and Moore, R. 2017. Google Earth Engine: Planetary-scale geospatial analysis for everyone. Remote Sensing of Environment, 202: 18–27. DOI: 10.1016/j.rse.2017.06.031
Open DOI Search in Google Scholar Back to article
Grønnestad, KS. 2016. Nyttige satellittar. Barentswatch. Available at https://www.barentswatch.no/artikler/nyttige-satellittar/ [Last accessed 16 01 2019].
Search in Google Scholar Back to article
Halsne, T and Dinessen, F. 2018. safe_to_netcdf. GitHub repository. Available at https://github.com/hevgyrt/safe_to_netcdf.git. (commit: 027f3ffd0106289f84a523c48e36abc5b64c4177) [Last accessed 18 11 2019].
Search in Google Scholar Back to article
Hankin, SC, Blower, J, Carval, T, Casey, K, Donlon, C, Lauret, O, Loubrieu, T, Srinivasan, A, Trinanes, J, Godøy, Ø, Mendelssohn, R, Signell, R, De La Beaujardiere, J, Cornillon, P, Blanc, F, Rew, R and Harlan, J. 2018. NETCDF-CF-OPENDAP: standards for ocean data interoperability and object lessons for community data standards processes.
Search in Google Scholar Back to article
Hansen, MC and Loveland, TR. 2012. A review of large area monitoring of land cover change using Landsat data. Remote Sensing of Environment, 122: 66–74. DOI: 10.1016/j.rse.2011.08.024
Open DOI Search in Google Scholar Back to article
Hey, T, Tansley, S and Tolle, K. 2009. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research.
Search in Google Scholar Back to article
Holmes, C. 2018. Analysis Ready Data Defined. Available at https://medium.com/planet-stories/analysis-ready-data-defined-5694f6f48815 [Last accessed 16 01 2019].
Search in Google Scholar Back to article
Laney, D. 2001. 3D data management: controlling data volume, velocity and variety. META Group Research Note.
Search in Google Scholar Back to article
Lewis, A, Oliver, S, Lymburner, L, Evans, B, Wyborn, L, Mueller, N, Raevksi, G, Hooke, J, Woodcock, R, Sixsmith, J, Wu, W, Tan, P, Li, F, Killough, B, Minchin, S, Roberts, D, Ayers, D, Bala, B, Dwyer, J, Dekker, A, Dhu, T, Hicks, A, Ip, A, Purss, M, Richards, C, Sagar, S, Trenham, C, Wang, P and Wang, L-W. 2017. The Australian Geoscience Data Cube — Foundations and lessons learned. Remote Sensing of Environment, 202: 276–292. DOI: 10.1016/j.rse.2017.03.015
Open DOI Search in Google Scholar Back to article
MuQun, Y, Robert, EM and Mike, F. 2005. HDF5 – a high performance data format for earth science. 21st International Conference on Interactive Information Processing Systems (IIPS) for Meteorology, Oceanography and Hydrology.
Search in Google Scholar Back to article
National Research Council. 2007. Earth Science and Applications from Space: National Imperatives for the Next Decade and Beyond. Washington, DC: The National Academies Press.
Search in Google Scholar Back to article
National Research Council, Mathae, KB and Uhlir, PF (Ed.). 2012. The Case for International Sharing of Scientific Data: A Focus on Developing Countries: Proceedings of a Symposium. Washington, DC: The National Academies Press.
Search in Google Scholar Back to article
Rew, R, Davis, G, Emmerson, S, Davies, H, Hartnett, E, Heimbigner, D and Fisher, W. 2019. NetCDF User’s Guide. Available at https://www.unidata.ucar.edu/software/netcdf/docs/index.html [Last accessed 16 01 2019].
Search in Google Scholar Back to article
Riccardo, P, Nuno, M and Hajduch, G. 2017. Thermal Denoising of Products Generated by the S-1 IPF. Available at https://sentinel.esa.int/documents/247904/2142675/Thermal-Denoising-of-Products-Generated-by-Sentinel-1-IPF [Last accessed 16 01 2019].
Search in Google Scholar Back to article
Teillet, PM, Chichagov, A, Fedosejevs, G, Gauthier, RP, Ainsley, G, Maloley, M, Guimond, M, Nadeau, C, Wehn, H and Shankaie, A. 2007. An integrated earth sensing sensorweb for improved crop and rangeland yield predictions. Canadian Journal of Remote Sensing, 33: 88–98. DOI: 10.5589/m07-012
Open DOI Search in Google Scholar Back to article
Turner, W, Rondinini, C, Pettorelli, N, Mora, B, Leidner, AK, Szantoi, Z, Buchanan, G, Dech, S, Dwyer, J, Herold, M, Koh, LP, Leimgruber, P, Taubenboeck, H, Wegmann, M, Wikelski, M and Woodcock, C. 2015. Free and open-access satellite data are key to biodiversity conservation. Biological Conservation, 182: 173–176. DOI: 10.1016/j.biocon.2014.11.048
Open DOI Search in Google Scholar Back to article
Westermann, S, Østby, TI, Gisnås, K, Schuler, TV and Etzelmüller, B. 2015. A ground temperature map of the North Atlantic permafrost region based on remote sensing and reanalysis data. The Cryosphere, 9: 1303–1319. DOI: 10.5194/tc-9-1303-2015
Open DOI Search in Google Scholar Back to article
White-Newsome, JL, Brines, SJ, Brown, DG, Dvonch, JT, Gronlund, CJ, Zhang, K, Oswald, EM and O’Neill, MS. 2013. Validating satellite-derived land surface temperature with in situ measurements: a public health perspective. Environmental health perspectives, 121: 925–931. DOI: 10.1289/ehp.1206176
Open DOI Search in Google Scholar Back to article
Wilkinson, MD, Dumontier, M, Aalbersberg, IJJ, Appleton, G, Axton, M, Baak, A, Blomberg, N, Boiten, J-W, da Silva Santos, LB, Bourne, PE, Bouwman, J, Brookes, AJ, Clark, T, Crosas, M, Dillo, I, Dumon, O, Edmunds, S, Evelo, CT, Finkers, R, Gonzalez-Beltran, A, Gray, AJG, Groth, P, Goble, C, Grethe, JS, Heringa, J, ’t Hoen, PAC, Hooft, R, Kuhn, T, Kok, R, Kok, J, Lusher, SJ, Martone, ME, Mons, A, Packer, AL, Persson, B, Rocca-Serra, P, Roos, M, van Schaik, R, Sansone, S-A, Schultes, E, Sengstag, T, Slater, T, Strawn, G, Swertz, MA, Thompson, M, van der Lei, J, van Mulligen, E, Velterop, J, Waagmeester, A, Wittenburg, P, Wolstencroft, K, Zhao, J and Mons, B. 2016. The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3: 160018. DOI: 10.1038/sdata.2016.18
Open DOI Search in Google Scholar Back to article
World Meteorological Organization. 2017. WIGOS Metadata Standard. Available at https://library.wmo.int/doc_num.php?explnum_id=3653 [Last accessed 18 11 2019].
Search in Google Scholar Back to article
Wulder, MA and Coops, NC. 2014. Satellites: Make Earth observations open access. Nature, 513: 30–31. DOI: 10.1038/513030a
Open DOI Search in Google Scholar Back to article
Wulder, MA, Coops, NC, Roy, DP, White, JC and Hermosilla, T. 2018. Land cover 2.0. International Journal of Remote Sensing, 39: 4254–4284. DOI: 10.1080/01431161.2018.1452075
Open DOI Search in Google Scholar Back to article
Yang, J, Gong, P, Fu, Rand Zhang, M, Chen, J, Liang, S, Xu, B, Shi, J and Dickinson, R. 2013. The role of satellite remote sensing in climate change studies. Nature Climate Change, 3: 875–883. DOI: 10.1038/nclimate1908
Open DOI Search in Google Scholar Back to article