Evidence-based Nomenclature and Taxonomy of Research Impact Indicators
References
- Arsalan, M., Mubin, O., & Al Mahmud, A. (2019). Evidence-based nomenclature and taxonomy of research impact indicators. In Proceedings of the 17th International Conference on Scientometrics and Informetrics (ISSI 2019), 2–5 September 2019, Sapienza University of Rome, Italy.
- Bennett, S., Reeve, R., Muir, K., Marjolin, A., & Powell, A. (2016). Orienting your journey: An approach for indicator assessment and selection. Retrieved from https://www.csi.edu.au/media/Orienting_Your_Journey_-_Change_Collection.pdf
- Bernstein, A., Hicks, V., Borbey, P., & Campbell, T. (2006). A framework to measure the impact of investments in health research. Paper presented at the presentation to the Blue Sky II conference, What Indicators for Science, Technology and Innovation Policies in the 21st Century.
- Buxton, M., & Hanney, S. (1996). How can payback from health services research be assessed? Journal of Health Services Research & Policy, 1(1), 35–43.
- Panel on Return on Investment in Health Research. (2009). Making an Impact: A Preferred Framework and Indicators to Measure Returns on Investment in Health Research, Canadian Academy of Health Sciences, Ottawa, ON, Canada.
- Deloitte Access Economics. (2011). Returns on NHMRC funded Research and Development. Commissioned by the Australian Society for Medical Research Sydney, Australia.
- Grant, J., Brutscher, P.B., Kirk, S.E., Butler, L., & Wooding, S. (2010). Capturing Research Impacts: A Review of International Practice. Documented Briefing. Rand Corporation, 92.
- Hayat, K. (2014). Nomenclature and its Importance in microbiology. Retrieved from https://medimoon.com/2014/04/nomenclature-and-its-importance-in-microbiology/
- Heller, C., & de Melo-Martín, I. (2009). Clinical and translational science awards: Can they increase the efficiency and speed of clinical and translational research? Academic Medicine, 84(4), 424–432.
- Kuruvilla, S., Mays, N., Pleasant, A., & Walt, G. (2006). Describing the impact of health research: A Research Impact Framework. BMC Health Serv Res, 6(1), 134. doi:10.1186/1472-6963-6-134
- Lewison, G. (2003). Beyond outputs: New measures of biomedical research impact. Aslib Proceedings: New Information Perspectives, 55(1/2), 32–42.
- Longabaugh, R., Fowler, D.R., Stout, R., & Kriebel, G. (1983). Validation of a problem-focused nomenclature. Archives of General Psychiatry, 40(4), 453–461.
- Maliha, G. (2018). Obsolete to Useful to Obsolete Once Again: A History of Section 507 of the Food, Drug, and Cosmetic Act. Food and Drug Law Journal, 73(3), 405.
- REF. (2012). Panel criteria and working methods. Retrieved from https://www.ref.ac.uk/2014/media/ref/content/pub/panelcriteriaandworkingmethods/01_12.pdf
- Trochim, W., Kane, C., Graham, M.J., & Pincus, H.A. (2011). Evaluating translational research: A process marker model. Clin Transl Sci, 4(3), 153–162. doi:10.1111/j.1752-8062.2011.00291.x
- United Way of America. (1996). Measuring program outcomes: A practical approach. Retrieved from https://digitalcommons.unomaha.edu/slceeval/47
- Vinkler, P. (2010a). The evaluation of research by scientometric indicators: Elsevier.
- Vinkler, P. (2010b). Indicators are the essence of scientometrics and bibliometrics. Scientometrics, 85(3), 861–866. doi:10.1007/s11192-010-0159-y
- Vinner, S., & Dreyfus, T. (1989). Images and definitions for the concept of function. Journal for Research in Mathematics Education, 356–366.
- VSNU, KNAW, & NWO. (2009). Standard evaluation Protocol 2009–2015: Protocol for research assessment in The Netherlands. Retrieved from https://www.knaw.nl/en/news/publications/standard-evaluation-protocol-sep-2009-2015
- Weiss, A.P. (2007). Measuring the impact of medical research: Moving from outputs to outcomes. Am J Psychiatry, 164(2), 206–214. doi:10.1176/ajp.2007.164.2.206
- Wellcome Trust. (2009). How we are making a difference: Assessment framework report summary. Retrieved from https://wellcome.ac.uk/sites/default/files/wtx059577_0.pdf
- Wiegers, S.E., Houser, S.R., Pearson, H.E., Untalan, A., Cheung, J.Y., Fisher, S.G., . . ., & Feldman, A.M. (2015). A Metric-Based System for Evaluating the Productivity of Preclinical Faculty at an Academic Medical Center in the Era of Clinical and Translational Science. Clinical and translational science, 8(4), 357–361. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5351026/pdf/CTS-8-357.pdf
- ARC. (2018). Excellence in Research for Australia (ERA) 2018: Submission Guidelines. Retrieved from http://www.arc.gov.au/sites/default/files/filedepot/Public/ERA/ERA%202018/ERA%202018%20Submission%20Guidelines.pdf
- Archambault, E., & Lariviere, V. (2009). History of the journal impact factor: Contingencies and consequences. Scientometrics, 79(3), 635–649. doi:10.1007/s11192-007-2036-x
- Aries, N.R., & Sclar, E.D. (1998). The economic impact of biomedical research: a case study of voluntary institutions in the New York metropolitan region. J Health Polit Policy Law, 23(1), 175–193. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/9522285
- Boell, S.K., & Wilson, C.S. (2010). Journal Impact Factors for evaluating scientific performance: use of h-like indicators. Scientometrics, 82(3), 613–626. doi:10.1007/s11192-010-0175-y
- Buxton, M., & Hanney, S. (1996). How can payback from health services research be assessed? J Health Serv Res Policy, 1(1), 35–43.
- CAHS. (2009). Making an Impact: A Preferred Framework and Indicators to Measure Returns on Investment in Health Research. Retrieved from Otawwa, Canada:
- Donaldson, N.E., Rutledge, D.N., & Ashley, J. (2004). Outcomes of adoption: measuring evidence uptake by individuals and organizations. Worldviews Evid Based Nurs, 1 Suppl 1(s1), S41–51. doi:10.1111/j.1524-475X.2004.04048.x
- Dougherty, D., & Conway, P.H. (2008). The “3T's” road map to transform US health care: the “how” of high-quality care. Jama, 299(19), 2319–2321. Retrieved from https://jamanetwork.com/journals/jama/articlepdf/181916/jco80037_2319_2321.pdf
- Egghe, L. (2006). Theory and practise of the g-index. Scientometrics, 69(1), 131–152. doi:10.1007/s11192-006-0144-7
- Engel-Cox, J.A., Van Houten, B., Phelps, J., & Rose, S.W. (2008). Conceptual model of comprehensive research metrics for improved human health and environment. Environ Health Perspect, 116(5), 583–592. doi:10.1289/ehp.10925
- Fu, H. Z., & Ho, Y.S. (2014). Top cited articles in adsorption research using Y-index. Research Evaluation, 23(1), 12–20. doi:10.1093/reseval/rvt018
- Garfield, E. (2006). Citation indexes for science. A new dimension in documentation through association of ideas. 1955. Int J Epidemiol, 35(5), 1123–1127; discussion 1127–1128. doi:10.1093/ije/dyl189
- Gordon, M., & Meadows, A. (1981). The dissemination of findings of DHSS funded research. Primary Communications Research Centre, Leicester: University of Leicester.
- Grant, J., Brutscher, P.-B., Kirk, S.E., Butler, L., & Wooding, S. (2010). Capturing Research Impacts: A Review of International Practice. Documented Briefing. Rand Corporation.
- Grant, J., Cottrell, R., Cluzeau, F., & Fawcett, G. (2000). Evaluating “payback” on biomedical research from papers cited in clinical guidelines: applied bibliometric study. Bmj, 320(7242), 1107–1111. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC27352/pdf/1107.pdf
- Hanney, S., Buxton, M., Green, C., Coulson, D., & Raftery, J. (2007). An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess, 11(53), iii–iv, ix–xi, 1–180.
- Hanney, S. R., Grant, J., Wooding, S., & Buxton, M.J. (2004). Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's’ Arthritis Research Campaign’. Health Research Policy and Systems, 2(1), 4. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC503400/pdf/1478-4505-2-4.pdf
- Harzing, A.-W.K. (2010). The publish or perish book: Tarma software research Melbourne.
- Haynes, B., & Haines, A. (1998). Barriers and bridges to evidence based clinical practice. Bmj, 317(7153), 273–276. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/9677226
- Haynes, B., & Haines, A. (1998). Barriers and bridges to evidence based clinical practice. Bmj, 317(7153), 273–276. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1113594/pdf/273.pdf
- Heller, C., & de Melo-Martín, I. (2009). Clinical and Translational Science Awards: can they increase the efficiency and speed of clinical and translational research? Academic Medicine, 84(4), 424–432.
- Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A, 102(46), 16569–16572. doi:10.1073/pnas.0507655102
- Hoffmann, C.P., Lutz, C., & Meckel, M. (2016). A relational altmetric? Network centrality on ResearchGate as an indicator of scientific impact. Journal of the Association for Information Science and Technology, 67(4), 765–775. doi:10.1002/asi.23423
- Järvelin, K., & Persson, O. (2008). The DCI index: Discounted cumulated impact-based research evaluation. Journal of the American Society for Information Science and Technology, 59(9), 1433–1440. doi:10.1002/asi.20847
- Jin, B.H., Liang, L.M., Rousseau, R., & Egghe, L. (2007). The R- and AR-indices: Complementing the h-index. Chinese science bulletin, 52(6), 855–863. doi:10.1007/s11434-007-0145-9
- Kalucy, E.C., Jackson-Bowers, E., McIntyre, E., & Reed, R. (2009). The feasibility of determining the impact of primary health care research projects using the Payback Framework. Health Research Policy and Systems, 7(1), 11.
- Kessler, R., & Glasgow, R.E. (2011). A Proposal to Speed Translation of Healthcare Research Into Practice Dramatic Change Is Needed. American journal of preventive medicine, 40(6), 637–644. doi:10.1016/j.amepre.2011.02.023
- Kuruvilla, S., Mays, N., Pleasant, A., & Walt, G. (2006). Describing the impact of health research: a Research Impact Framework. BMC Health Serv Res, 6(1), 134. doi:10.1186/1472-6963-6-134
- Largent, M. A., & Lane, J.I. (2012). STAR METRICS and the Science of Science Policy. Review of Policy Research, 29(3), 431–438. doi:10.1111/j.1541-1338.2012.00567.x
- Lavis, J., Ross, S., McLeod, C., & Gildiner, A. (2003). Measuring the impact of health research. J Health Serv Res Policy, 8(3), 165–170. doi:10.1258/135581903322029520
- Lewison, G. (2003). Beyond outputs: new measures of biomedical research impact. Paper presented at the Aslib Proceedings.
- Lindsay, J. M. (2016). PlumX from plum analytics: not just altmetrics. Journal of Electronic Resources in Medical Libraries, 13(1), 8–17.
- Maliha, G. (2018). Obsolete to Useful to Obsolete Once Again: A History of Section 507 of the Food, Drug, and Cosmetic Act.
- Mankoff, S. P., Brander, C., Ferrone, S., & Marincola, F.M. (2004). Lost in Translation: Obstacles to Translational Medicine. J Transl Med, 2(1), 14. doi:10.1186/1479-5876-2-14
- Moed, H., De Bruin, R., & Van Leeuwen, T. (1995). New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications. Scientometrics, 33(3), 381–422.
- Mostert, S. P., Ellenbroek, S.P.H., Meijer, I., van Ark, G., & Klasen, E.C. (2010). Societal output and use of research performed by health research groups. Health Research Policy and Systems, 8(1), 30. doi:10.1186/1478-4505-8-30
- Nathan, D.G. (2002). Careers in translational clinical research—historical perspectives, future challenges. Jama, 287(18), 2424–2427. Retrieved from https://jamanetwork.com/journals/jama/articlepdf/194890/JCO20035.pdf
- Pang, T., Sadana, R., Hanney, S., Bhutta, Z.A., Hyder, A.A., & Simon, J. (2003). Knowledge for better health: a conceptual framework and foundation for health research systems. Bull World Health Organ, 81(11), 815–820. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/14758408
- Penfield, T., Baker, M.J., Scoble, R., & Wykes, M.C. (2014). Assessment, evaluations, and definitions of research impact: A review. Research Evaluation, 23(1), 21–32. doi:10.1093/reseval/rvt021
- Pober, J.S., Neuhauser, C.S., & Pober, J.M. (2001). Obstacles facing translational research in academic medical centers. FASEB J, 15(13), 2303–2313. doi:10.1096/fj.01-0540lsf
- Raftery, J., Hanney, S., Greenhalgh, T., Glover, M., & Blatch-Jones, A. (2016). Models and applications for measuring the impact of health research: update of a systematic review for the Health Technology Assessment programme. Health Technol Assess, 20(76), 1–254. doi:10.3310/hta20760
- RAND Europe. (2006). Measuring the benefits from research. Cambridge, England. Retrieved from https://www.rand.org/content/dam/rand/pubs/research_briefs/2007/RAND_RB9202.pdf
- Sarli, C.C., Dubinsky, E.K., & Holmes, K.L. (2010). Beyond citation analysis: a model for assessment of research impact. J Med Libr Assoc, 98(1), 17–23. doi:10.3163/1536-5050.98.1.008
- Sidiropoulos, A., Katsaros, D., & Manolopoulos, Y. (2007). Generalized Hirsch h-index for disclosing latent facts in citation networks. Scientometrics, 72(2), 253–280. doi:10.1007/s11192-007-1722-z
- Sung, N.S., Crowley, W.F., Jr., Genel, M., Salber, P., Sandy, L., Sherwood, L.M., . . . Rimoin, D. (2003). Central challenges facing the national clinical research enterprise. Jama, 289(10), 1278–1287. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/12633190
- Torres-Salinas, D., Moreno-Torres, J.G., Delgado-López-Cózar, E., & Herrera, F. (2011). A methodology for Institution-Field ranking based on a bidimensional analysis: the IFQ 2 A index. Scientometrics, 88(3), 771–786. doi:10.1007/s11192-011-0418-6
- Trochim, W., Kane, C., Graham, M.J., & Pincus, H.A. (2011). Evaluating translational research: a process marker model. Clin Transl Sci, 4(3), 153–162. doi:10.1111/j.1752-8062.2011.00291.x
- Trochim, W.M., Marcus, S.E., Masse, L.C., Moser, R.P., & Weld, P.C. (2008). The evaluation of large research initiatives—A participatory integrative mixed-methods approach. American Journal of Evaluation, 29(1), 8–28. doi:10.1177/1098214007309280
- Vanclay, J.K., & Bornmann, L. (2012). Metrics to evaluate research performance in academic institutions: a critique of ERA 2010 as applied in forestry and the indirect H-2 index as a possible alternative. Scientometrics, 91(3), 751–771. doi:10.1007/s11192-012-0618-8
- Vinkler, P. (20 14). The use of the Percentage Rank Position index for comparative evaluation of journals. Journal of Informetrics, 8(2), 340–348. doi:10.1016/j.joi.2014.01.001
- Wang, L., Wen, H., & Liu, Y. (2016). AHP Based Quantitative Evaluation Index System of Teacher's Research Performance in the University. International Journal of Multimedia and Ubiquitous Engineering, 11(7), 391–402. doi:10.14257/ijmue.2016.11.7.39
- Weiss, A.P. (2 007). Measuring the impact of medical research: moving from outputs to outcomes. Am J Psychiatry, 164(2), 206–214. doi:10.1176/ajp.2007.164.2.206
- Westfall, J.M., Mold, J., & Fagnan, L. (2007). Practice-based research—“Blue Highways” on the NIH roadmap. Jama, 297(4), 403–406. Retrieved from https://jamanetwork.com/journals/jama/articlepdf/205216/jco60049_403_406.pdf
- Williams, A.E. (20 17). Altmetrics: an overview and evaluation. Online Information Review, 41(3), 311–317. doi:10.1108/Oir-10-2016-0294
- Williams, V., Eiseman, E., Landree, E., & Adamson, D. (2009). Demonstrating and Communicating Research Impact. Preparing NIOSH Programs for External Review. Retrieved from
- Woolf, S.H. (2008). The meaning of translational research and why it matters. Jama, 299(2), 211–213. doi:10.1001/jama.2007.26
- Zerhouni, E.A. (20 07). Translational research: moving discovery to practice. Clin Pharmacol Ther, 81(1), 126–128. doi:10.1038/sj.clpt.6100029
- Zhai, L., Yan, X., & Zhu, B. (2013). The Hl-index: improvement of H-index based on quality of citing papers. Scientometrics, 98(2), 1021–1031. doi:10.1007/s11192-013-1039-z
Language: English
Page range: 33 - 56
Submitted on: Jan 28, 2020
Accepted on: May 20, 2020
Published on: Jul 3, 2020
Published by: Chinese Academy of Sciences, National Science Library
In partnership with: Paradigm Publishing Services
Publication frequency: 4 times per year
Related subjects:
© 2020 Mudassar Arsalan, Omar Mubin, Abdullah Al Mahmud, published by Chinese Academy of Sciences, National Science Library
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.