Community Recommendations for Sustainable Scientific Software

Robert R. Downs; W. Christopher Lenhardt; Erin Robinson; Ethan Davis; Nicholas Weber

doi:10.5334/jors.bt

Abstract

Science software has contributed to research practices, but the sustainability of scientific software presents challenges for the future use of research resources. Identifying improvements for science software sustainability practices can contribute to the re-use of science software. A focus group study was conducted to identify ways to improve science software sustainability practices of the Earth science community. A facilitated, roundtable discussion activity at the 2014 Federation of Earth Science Information Partners (ESIP) Summer Meeting elicited recommendations on community activities to improve practices for the sustainability of scientific software. These suggestions fell into three broad themes – (1) improving collaboration and community engagement through publications and presentations (2) developing workshops, training, and documenting best practices and (3) creating incentives and motivation with awards, citation and a reviewed software repository. In addition to the recommendations coming out of the roundtable activity, this paper highlights how community-led groups such as ESIP are key to move a sustainable software effort in its various forms from concept to reality.

References

Goble C Better software, better research Internet Computing 2014 IEEE 18 5 4 8 10.1109/MIC.2014.88
Open DOI Search in Google Scholar Back to article
Venters C C Lau L Griffiths M K Holmes V Ward R R Jay C Dibsdale C E Xu J The Blind Men and the Elephant: Towards an Empirical Evaluation Framework for Software Sustainability Journal of Open Research Software 2014 2 1 e8 10.5334/jors.ao
Open DOI Search in Google Scholar Back to article
Downs R R Marshall J J A Proposal on Using Reuse Readiness Levels to Measure Software Reusability Data Science Journal 2010 9 73 92 10.2481/dsj.009-007
Open DOI Search in Google Scholar Back to article
Stodden V Miguez S Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research Journal of Open Research Software 2014 2 1 e21 10.5334/jors.ay
Open DOI Search in Google Scholar Back to article
Merali Z Computational science: Error, why scientific programming does not compute Nature 2010 467 7317 775 777 10.1038/467775a
Open DOI Search in Google Scholar Back to article
Blanton B Lenhardt C A Scientist’s Perspective on Sustainable Scientific Software Journal of Open Research Software 2014 2 1 e17 10.5334/jors.ba
Open DOI Search in Google Scholar Back to article
Duerr R E Downs R R Tilmes C Barkstrom B Lenhardt W C Glassy J Bermudez L E Slaughter P On the Utility of Identification Schemes for Digital Earth Science Data: An Assessment and Recommendations Earth Science Informatics 2011 4 3 139 160 10.1007/s12145-011-0083-6
Open DOI Search in Google Scholar Back to article
Wilson A Downs R R Lenhardt W C Meyer C Michener W Ramapriyan H Robinson E Realizing the Value of a National Asset: Scientific Data Eos Transactions of the American Geophysical Union 2014 95 50 477 478 10.1002/2014EO500006
Open DOI Search in Google Scholar Back to article
Howison J Herbsleb J D The sustainability of scientific software: ecosystem context and science 2014 Available at: http://james.howison.name/pubs/HowisonHerbsleb-Sustainability.pdf
Search in Google Scholar Back to article
Katz D S Choi S T Lapp H Maheshwari K Löffler F Turk M Hanwell M D Wilkins-Diehr N Hetherington J Howison J Swenson S Allen G D Elster A C Berriman B Venters C Summary of the First Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE1) Journal of Open Research Software 2014 2 1 e6 10.5334/jors.an
Open DOI Search in Google Scholar Back to article
Lenhardt W C Ahalt S Blanton B Christopherson L Idaszak R Data Management Lifecycle and Software Lifecycle Management in the Context of Conducting Science Journal of Open Research Software 2014 2 1 e15 10.5334/jors.ax
Open DOI Search in Google Scholar Back to article
Morgan D L Focus Groups Annual Review of Sociology 1996 22 129 152 10.1146/annurev.soc.22.1.129 Available at: http://www.jstor.org/stable/2083427
Open DOI Search in Google Scholar Back to article
Kontio J Bragge J Lehtola L The focus group method as an empirical tool in software engineering Guide to advanced empirical software engineering 2008 London Springer 93 116 10.1007/978-1-84800-044-5_4
Open DOI Search in Google Scholar Back to article
Carlsen B Glenton C What about N? A methodological study of sample-size reporting in focus group studies BMC Medical Research Methodology 2011 11 1 26 10.1186/1471-2288-11-26
Open DOI Search in Google Scholar Back to article
Onwuegbuzie A J Leech N L A call for qualitative power analyses Quality & Quantity 2007 41 1 105 121 10.1007/s11135-005-1098-1
Open DOI Search in Google Scholar Back to article
Duerr R Hoebelheinrich N J Data Management for Scientists Short Course Federation of Earth Science Information Partners: ESIP Commons 2012 Available at: http://commons.esipfed.org/datamanagementshortcourse
Search in Google Scholar Back to article
ESIP Data Stewardship Committee Data Citation Guidelines for Data Providers and Archives Federation of Earth Science Information Partners: ESIP Commons 2012 10.7269/P34F1NNJ Available at: http://commons.esipfed.org/node/308
Open DOI Search in Google Scholar Back to article
NASA Earth Science Data Systems Software Reuse Working Group Reuse Readiness Levels (RRLs), V1.0 2010 April 30 Available at: https://earthdata.nasa.gov/esdswg/software-reuse/reuse-readiness-levels-rrls
Search in Google Scholar Back to article
Mankins J C Technology Readiness Levels National Aeronautics and Space Administration 1995 Available at: http://www.hq.nasa.gov/office/codeq/trl/trl.pdf
Search in Google Scholar Back to article
Lenhardt W C Downs R R Weber N Robinson E ESIP 2014 Summer Meeting Roundtable 2014 Summer Meeting of the Federation of Earth Science Information Partners July 8–11, 2014 2014 Colorado Copper Mountain July 9 Available at: http://commons.esipfed.org/node/2368
Search in Google Scholar Back to article

Community Recommendations for Sustainable Scientific Software

Abstract

Paradigm

My account