General laws of funding for scientific citations: how citations change in funded and unfunded research between basic and applied sciences

Coccia, Mario; Roshani, Saeed

doi:10.2478/jdis-2024-0005

Abstract

Purpose

The goal of this study is to analyze the relationship between funded and unfunded papers and their citations in both basic and applied sciences.

Design/methodology/approach

A power law model analyzes the relationship between research funding and citations of papers using 831,337 documents recorded in the Web of Science database.

Findings

The original results reveal general characteristics of the diffusion of science in research fields: a) Funded articles receive higher citations compared to unfunded papers in journals; b) Funded articles exhibit a super-linear growth in citations, surpassing the increase seen in unfunded articles. This finding reveals a higher diffusion of scientific knowledge in funded articles. Moreover, c) funded articles in both basic and applied sciences demonstrate a similar expected change in citations, equivalent to about 1.23%, when the number of funded papers increases by 1% in journals. This result suggests, for the first time, that funding effect of scientific research is an invariant driver, irrespective of the nature of the basic or applied sciences.

Originality/value

This evidence suggests empirical laws of funding for scientific citations that explain the importance of robust funding mechanisms for achieving impactful research outcomes in science and society. These findings here also highlight that funding for scientific research is a critical driving force in supporting citations and the dissemination of scientific knowledge in recorded documents in both basic and applied sciences.

Practical implications

This comprehensive result provides a holistic view of the relationship between funding and citation performance in science to guide policymakers and R&D managers with science policies by directing funding to research in promoting the scientific development and higher diffusion of results for the progress of human society.

References

Adams, J. (2013). The fourth age of research. Nature, 497(7451), 557–560.
Search in Google Scholar Back to article
Boyack, K. W. (2004). Mapping knowledge domains: Characterizing PNAS. Proceedings of the National Academy of Sciences, 101(suppl_1), 5192–5199. DOI:10.1073/pnas.0307509100.
Open DOI Search in Google Scholar Back to article
Boyack, K. W., Klavans, R., & Börner, K. (2005). Mapping the backbone of science. Scientometrics, 64, 351–374. DOI: 10.1007/s11192-005-0255-6.
Open DOI Search in Google Scholar Back to article
Clarivate (2023). Web of Science Coverage Details. https://clarivate.libguides.com/librarianresources/coverage (Accessed 5 September 2023)
Search in Google Scholar Back to article
Coccia M., Bozeman B. (2016). Allometric models to measure and analyze the evolution of international research collaboration, Scientometrics, 108(3), 1065–1084, DOI: 10.1007/s11192-016-2027-x
Open DOI Search in Google Scholar Back to article
Coccia, M. (2018). General properties of the evolution of research fields: a scientometric study of human microbiome, evolutionary robotics and astrobiology, Scientometrics, 117(2), 1265–1283, https://doi.org/10.1007/s11192-018-2902-8
Open DOI Search in Google Scholar Back to article
Coccia, M. (2020). The evolution of scientific disciplines in applied sciences: dynamics and empirical properties of experimental physics, Scientometrics, 124, 451–487. https://doi.org/10.1007/s11192-020-03464-y
Open DOI Search in Google Scholar Back to article
Coccia, M., & Wang, L. (2016). Evolution and convergence of the patterns of international scientific collaboration. Proceedings of the National Academy of Sciences, 113(8), 2057–2061. DOI: 10.1073/pnas.1510820113.
Open DOI Search in Google Scholar Back to article
Coccia M. (2021). Evolution and structure of research fields driven by crises and environmental threats: the COVID-19 research. Scientometrics, 126(12), 9405–9429. https://doi.org/10.1007/s11192-021-04172-x
Open DOI Search in Google Scholar Back to article
Coccia M., Roshani S., Mosleh M. (2021). Scientific Developments and New Technological Trajectories in Sensor Research. Sensors, 21(23), 7803. https://doi.org/10.3390/s21237803
Open DOI Search in Google Scholar Back to article
Coccia, M., Roshani, S., Mosleh, M. (2022). Evolution of Sensor Research for Clarifying the Dynamics and Properties of Future Directions. Sensors, 22(23), 9419. https://doi.org/10.3390/s22239419
Open DOI Search in Google Scholar Back to article
Coccia M., Mosleh M., Roshani S., (2022a). Evolution of quantum computing: Theoretical and innovation management implications for emerging quantum industry. IEEE Transactions on Engineering Management, DOI (identifier): 10.1109/TEM.2022.3175633.
Open DOI Search in Google Scholar Back to article
Coccia M. (2022). Probability of discoveries between research fields to explain scientific and technological change. Technology in Society, 68, 101874. https://doi.org/10.1016/j.techsoc.2022.101874.
Open DOI Search in Google Scholar Back to article
Coccia M. (2019). Intrinsic and extrinsic incentives to support motivation and performance of public organizations. Journal of Economics Bibliography, 6(1): 20–29, http://dx.doi.org/10.1453/jeb.v6i1.1795.
Open DOI Search in Google Scholar Back to article
Coccia, M. 2019b. Comparative Institutional Changes. A. Farazmand (ed.), Global Encyclopedia of Public Administration, Public Policy, and Governance, Springer Nature. https://doi.org/10.1007/978-3-319-31816-5_1277-1.
Open DOI Search in Google Scholar Back to article
Coccia, M., Roshani, S. (2024). The Relation Between Research Funding and Citations in Papers of Nobel Laureates in Physics, Chemistry and Medicine, 2019-2020. Journal of Data and Information Science, 8(4), 1–23. https://doi.org/10.2478/jdis-2023-0025.
Open DOI Search in Google Scholar Back to article
Davidson Frame, J., & Carpenter, M. P. (1979). International research collaboration. Social studies of science, 9(4), 481–497. DOI:10.1177/030631277900900405.
Open DOI Search in Google Scholar Back to article
Falagas, M. E., Pitsouni, E. I., Malietzis, G. A., & Pappas, G. (2008). Comparison of PubMed, Scopus, Web of Science, and Google Scholar: Strengths and weaknesses. FASEB Journal: Official Publication of the Federation of American Societies for Experimental Biology, 22(2), 338–342. https://doi.org/10.1096/fi.07-9492LSF.
Open DOI Search in Google Scholar Back to article
Fanelli, D., & Glänzel, W. (2013). Bibliometric evidence for a hierarchy of the sciences. PLoS one, 8(6), e66938. DOI: 10.1371/journal.pone.0066938.
Open DOI Search in Google Scholar Back to article
Fortunato, S.,Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., … & Barabási, A. L. (2018). Science of science. Science, 359(6379), eaao0185. DOI: 10.1126/science. aao0185.
Open DOI Search in Google Scholar Back to article
Grassano, N., Rotolo, D., Hutton, J., Lang, F., & Hopkins, M. M. (2017). Funding data from publication acknowledgments: Coverage, uses, and limitations. Journal of the Association for Information Science and Technology, 68(4), 999–1017.
Search in Google Scholar Back to article
Hicks, D., & Isett, K. R. (2020). Powerful numbers: Exemplary quantitative studies of science that had policy impact. Quantitative Science Studies, 1(3), 969–982. Available at: http://works.bepress.com/diana_hicks/54/
Search in Google Scholar Back to article
Katz, J. S., & Ronda-Pupo, G. A. (2019). Cooperation, scale-invariance and complex innovation systems: a generalization. Scientometrics, 121(2), 1045–1065. DOI: 10.1007/s11192-019-03215-8.
Open DOI Search in Google Scholar Back to article
Kitcher, P. (2003). Science, truth, and democracy. Oxford University Press.
Search in Google Scholar Back to article
Leguendre, P., & Leguendre, L. (2012). Numerical ecology (3rd ed., Vol. 24). Great Britain: Elsevier B. V
Search in Google Scholar Back to article
Li, E. Y., Liao, C. H., & Yen, H. R. (2013). Co-authorship networks and research impact: A social capital perspective. Research Policy, 42(9), 1515–1530. DOI: 10.1016/j.respol.2013.06.012.
Open DOI Search in Google Scholar Back to article
MacLean, M., Davies, C., Lewison, G., & Anderson, J. (1998). Evaluating the research activity and impact of funding agencies. Research Evaluation, 7(1), 7–16. DOI: 10.1093/rev/7.1.7.
Open DOI Search in Google Scholar Back to article
Merton, R. K. (1988). The Matthew effect in science, II: Cumulative advantage and the symbolism of intellectual property. Isis, 79(4), 606–623. DOI: 10.1086/354848.
Open DOI Search in Google Scholar Back to article
Morillo, F. (2020). Is open access publication useful for all research fields? Presence of funding, collaboration and impact. Scientometrics, 125(1), 689–716. DOI:10.1007/s11192-020-03652-w.
Open DOI Search in Google Scholar Back to article
Mosleh, M., Roshani, S., & Coccia, M. (2022). Scientific laws of research funding to support citations and diffusion of knowledge in life science. Scientometrics, 127(4), 1931–1951. DOI: 10.1007/s11192-022-04300-1.
Open DOI Search in Google Scholar Back to article
Newman, M. E. (2004). Coauthorship networks and patterns of scientific collaboration. Proceedings of the national academy of sciences, 101(suppl_1), 5200–5205. DOI: 10.1073/pnas.0307545100.
Open DOI Search in Google Scholar Back to article
OECD 2023. Open science. https://www.oecd.org/sti/inno/open-science.htm (accessed 18 October 2023)
Search in Google Scholar Back to article
Pagliaro, M., Coccia M. (2021). How self-determination of scholars outclasses shrinking public research lab budgets, supporting scientific production: a case study and R&D management implications. Heliyon, 7(1), e05998. https://doi.org/10.1016/j.heliyon.2021.e05998
Open DOI Search in Google Scholar Back to article
Pao, M. L. (1991). On the relationship of funding and research publications. Scientometrics, 20(1), 257–281. DOI:10.1007/BF02018158.
Open DOI Search in Google Scholar Back to article
Pranckutė, R. (2021). Web of Science (WoS) and Scopus: The titans of bibliographic information in today’s academic world. Publications, 9(1), 12. doi.org/10.3390/publications9010012
Open DOI Search in Google Scholar Back to article
Price, D. D. S. (1976). A general theory of bibliometric and other cumulative advantage processes. Journal of the American Society for Information Science, 27(5), 292–306. DOI: 10.1002/asi.4630270505.
Open DOI Search in Google Scholar Back to article
Price, D. J. (1986). Little science, big science... and beyond. New York: Columbia University Press.
Search in Google Scholar Back to article
Quinlan, K. M., Kane, M., & Trochim, W. M. (2008). Evaluation of large research initiatives: Outcomes, challenges, and methodological considerations. New directions for evaluation, 118, 61–72. DOI: 10.1002/ev.261
Open DOI Search in Google Scholar Back to article
Radicchi, F., Fortunato, S., & Castellano, C. (2008). Universality of citation distributions: Toward an objective measure of scientific impact. Proceedings of the National Academy of Sciences, 105(45), 17268–17272. DOI: 10.1073/pnas.0806977105.
Open DOI Search in Google Scholar Back to article
Ronda-Pupo, G. A. (2017). The citation-based impact of complex innovation systems scales with the size of the system. Scientometrics, 112(1), 141–151.
Search in Google Scholar Back to article
Ronda-Pupo, G. A. (2021). Cuba—US scientific collaboration: Beyond the embargo. Plos one, 16(7), e0255106.
Search in Google Scholar Back to article
Ronda-Pupo, G. A., & Katz, J. S. (2016). The power–law relationship between citation-based performance and collaboration in articles in management journals: A scale-independent approach. Journal of the Association for Information Science and Technology, 67(10), 2565–2572. DOI:10.1002/asi.23575.
Open DOI Search in Google Scholar Back to article
Ronda-Pupo, G. A., & Katz, J. S. (2017a). The scaling relationship between citation-based performance and coauthorship patterns in natural sciences. Journal of the Association for Information Science and Technology, 68(5), 1257–1265. DOI:10.1002/asi.23759.
Open DOI Search in Google Scholar Back to article
Ronda-Pupo, G. A., & Katz, J. S. (2017b). The scaling relationship between degree centrality of countries and their citation-based performance on Management Information Systems. Scientometrics, 112(3), 1285–1299.
Search in Google Scholar Back to article
Ronda-Pupo, G. A., & Katz, J. S. (2018). The power law relationship between citation impact and multi-authorship patterns in articles in Information Science & Library Science journals. Scientometrics, 114, 919–932. DOI: 10.1007/s11192-017-2612-7.
Open DOI Search in Google Scholar Back to article
Roshani S., Coccia, M. Mosleh M., (2022). Senor technology for opening new pathways in diagnosis and therapeutics of breast, lung, colorectal and prostate cancer. HighTech and Innovation Journal. J. 3 (3) 356–375, https://doi.org/10.28991/HIJ-2022-03-03-010.
Open DOI Search in Google Scholar Back to article
Roshani, S., Bagherylooieh, M. R., Mosleh, M., & Coccia, M. (2021). What is the relationship between research funding and citation-based performance? A comparative analysis between critical disciplines. Scientometrics, 126(9), 7859–7874. DOI:10.1007/s11192-021-04077-9.
Open DOI Search in Google Scholar Back to article
Simonton, D. K. (2004). Psychology’s status as a scientific discipline: Its empirical placement within an implicit hierarchy of the sciences. Review of General Psychology, 8(1), 59–67. DOI: 10.1037/1089-2680.8.1.59.
Open DOI Search in Google Scholar Back to article
Singh, V. K., Singh, P., Karmakar, M., Leta, J., …, Mayr, P. (2021). The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis. Scientometrics, 126, 5113–5142.
Search in Google Scholar Back to article
Small, H. (1999). Visualizing science by citation mapping. Journal of the American society for Information Science, 50(9), 799–813. DOI: 10.1002/(SICI)1097-4571
Open DOI Search in Google Scholar Back to article
Smith, L. D., Best, L. A., Stubbs, D. A., Johnston, J., & Archibald, A. B. (2000). Scientific graphs and the hierarchy of the sciences: A Latourian survey of inscription practices. Social studies of science, 30(1), 73–94. DOI: 10.1177/030631200030001003.
Open DOI Search in Google Scholar Back to article
Smith, R. J. (2009). Use and misuse of the reduced major axis for line-fitting. American Journal of Physical Anthropology, 140(3), 476–486.
Search in Google Scholar Back to article
Stephan, P. E. (1996). The economics of science. Journal of Economic literature, 34(3), 1199–1235.
Search in Google Scholar Back to article
Storer, N. W. (1967). The hard sciences and the soft: Some sociological observations. Bulletin of the Medical Library Association, 55(1), 75.
Search in Google Scholar Back to article
Wang J., P. Shapira. (2015). Is There a Relationship between Research Sponsorship and Publication Impact? An Analysis of Funding Acknowledgments in Nanotechnology Papers. PLoS ONE 10, e0117727. DOI: 10.1371/journal.pone.0117727.
Open DOI Search in Google Scholar Back to article
Web of Science 2023. Web of Science, Search in: Web of Science Core Collection, http://apps.webofknowledge.com/WOS_GeneralSearch_input.do?product=WOS&SID=E5lSYgaLwJn 6kp2iz2G&search_mode=GeneralSearch (Accessed 10 May 2023)
Search in Google Scholar Back to article
Yan, E. J, Wu, C. J., & Song, M. (2018). The funding factor: A cross-disciplinary examination of the association between research funding and citation impact. Scientometrics, 115, 369–384. DOI: 10.1007/s11192-017-2583-8.
Open DOI Search in Google Scholar Back to article