Towards Reliable Resilience Metrics in Corporate Settings: Content Validity Considerations
By: Enrico Schötz
References
- Annarelli, A., & Nonino, F. (2016). Strategic and operational management of organizational resilience: Current state of research and future directions. Omega, 62, 1–18. https://doi.org/10.1016/j.omega.2015.08.004
- Asheim, G. B., Bossert, W., D’Ambrosio, C., & Vögele, C. (2020). The measurement of resilience. Journal of Economic Theory, 189, 105104. https://doi.org/10.1016/j.jet.2020.105104
- Bishop, P. A., & Herron, R. L. (2015). Use and Misuse of the Likert Item Responses and Other Ordinal Measures. International Journal of Exercise Science, 8(3), 297–302. https://doi.org/10.70252/LANZ1453
- Bruneau, M., Chang, S. E., Eguchi, R. T., Lee, G. C., O’Rourke, T. D., Reinhorn, A. M., Shinozuka, M., Tierney, K., Wallace, W. A., & von Winterfeldt, D. (2003). A Framework to Quantitatively Assess and Enhance the Seismic Resilience of Communities. Earthquake Spectra, 19(4), 733-752. https://doi.org/10.1193/1.1623497
- Cardoso, S. R., Paula Barbosa-Póvoa, A., Relvas, S., & Novais, A. Q. (2015). Resilience metrics in the assessment of complex supply-chains performance operating under demand uncertainty. Omega, 56, 53–73. https://doi.org/10.1016/j.omega.2015.03.008
- Cheng, Y., Elsayed, E. A., & Huang, Z. (2022). Systems resilience assessments: a review, framework and metrics. International Journal of Production Research, 60(2), 595-622. https://doi.org/10.1080/00207543.2021.1971789
- Conz, E., & Magnani, G. (2020). A dynamic perspective on the resilience of firms: A systematic literature review and a framework for future research. European Management Journal, 38(3), 400–412. https://doi.org/10.1016/j.emj.2019.12.004
- Costello, G. J. (2018). Proposing an innovation-based view of the firm. The Irish Journal of Management, 37(1), 65–79. https://doi.org/10.2478/ijm-2018-0006
- D’Lima, M., & Medda, F. (2015). A new measure of resilience: An application to the London Underground. Transportation Research Part A: Policy and Practice, 81, 35–46. https://doi.org/10.1016/j.tra.2015.05.017
- Dalziell, E. P., & McManus, S. T. (2004). Resilience, Vulnerability, and Adaptive Capacity: Implications for System Performance. International Forum for Engineering Decision Making (IFED), Stoos, Switzerland.
- DeVellis, R. F. (2009). Scale development: Theory and applications (2nd ed.). Sage Publications, Inc.
- Diamantopoulos, A. (2005). The C-OAR-SE procedure for scale development in marketing: A comment. International Journal of Research in Marketing, 22(1), 1–9. https://doi.org/10.1016/j.ijresmar.2003.08.002
- Dormady, N. C., Rose, A., Roa-Henriquez, A., & Morin, C. B. (2022). The cost-effectiveness of economic resilience. International Journal of Production Economics, 244, 108371. https://doi.org/10.1016/j.ijpe.2021.108371
- Erol, O., Henry, D., Sauser, B., & Mansouri, M. (2010). Perspectives on measuring enterprise resilience. In R. C. Rassa (Ed.), 2010 IEEE International Systems Conference: SysCon 2010; San Diego, California, USA, 5—8 April 2010 (pp. 587–592). IEEE. https://doi.org/10.1109/SYSTEMS.2010.5482333
- Esteve-Pérez, S., & Mañez-Castillejo, J. A. (2008). The Resource-Based Theory of the Firm and Firm Survival. Small Business Economics, 30(3), 231–249. https://doi.org/10.1007/s11187-006-9011-4
- Fraccascia, L., Giannoccaro, I., & Albino, V. (2018). Resilience of Complex Systems: State of the Art and Directions for Future Research. Complexity, 2018(1), 1–44. https://doi.org/10.1155/2018/3421529
- Gladen, W. (2014). Performance Measurement. Springer Gabler.
- Gleich, R. (2021). Performance Measurement. Franz Vahlen GmbH.
- Gligor, D., Gligor, N., Holcomb, M., & Bozkurt, S. (2019). Distinguishing between the concepts of supply chain agility and resilience. The International Journal of Logistics Management, 30(2), 467–487. https://doi.org/10.1108/IJLM-10-2017-025 9
- Hand, D. J. (1996). Statistics and the Theory of Measurement. Journal of the Royal Statistical Society. Series A (Statistics in Society), 159(3), 445. https://doi.org/10.2307/2983326
- Henry, D., & Emmanuel Ramirez-Marquez, J. (2012). Generic metrics and quantitative approaches for system resilience as a function of time. Reliability Engineering & System Safety, 99, 114-122. https://doi.org/10.1016/j.ress.2011.09.002
- Hillmann, J. (2021). Disciplines of organizational resilience: Contributions, critiques, and future research avenues. Review of Managerial Science, 15(4), 879–936. https://doi.org/10.1007/s11846-020-00384-2
- Hosseini, S., Barker, K., & Ramirez-Marquez, J. E. (2016). A review of definitions and measures of system resilience. Reliability Engineering & System Safety, 145, 47–61. https://doi.org/10.1016/j.ress.2015.08.006
- Iftikhar, A., Purvis, L., & Giannoccaro, I. (2021). A meta-analytical review of antecedents and outcomes of firm resilience. Journal of Business Research, 135, 408–425. https://doi.org/10.1016/j.jbusres.2021.06.048
- Ilseven, E., & Puranam, P. (2021). Measuring organizational resilience as a performance outcome. Journal of Organization Design, 10(3–4), 127–137. https://doi.org/10.1007/s41469-021-00107-1
- Jamieson, S. (2004). Likert scales: How to (ab)use them. Medical Education, 38(12), 1217–1218. https://doi.org/10.1111/j.1365-2929.2004.02012.x
- Jones, L., A. Constas, M., Matthews, N., & Verkaart, S. (2021). Advancing resilience measurement. Nature Sustainability, 4(4), 288–289. https://doi.org/10.1038/s41893-020-00642-x
- Kamalahmadi, M., & Parast, M. M. (2016). A review of the literature on the principles of enterprise and supply chain resilience: Major findings and directions for future research. International Journal of Production Economics, 171, 116–133. https://doi.org/10.1016/j.ijpe.2015.10.023
- Klimek, P., Varga, J., Jovanovic, A. S., & Székely, Z. (2019). Quantitative resilience assessment in emergency response reveals how organizations trade efficiency for redundancy. Safety Science, 113, 404–414. https://doi.org/10.1016/j.ssci.2018.12.017
- Korber, S., & McNaughton, R. B. (2018). Resilience and entrepreneurship: A systematic literature review. International Journal of Entrepreneurial Behavior & Research, 24(7), 1129–1154. https://doi.org/10.1108/IJEBR-10-2016-0356
- Lee, A. V., Vargo, J., & Seville, E. (2013). Developing a Tool to Measure and Compare Organizations’ Resilience. Natural Hazards Review, 14(1), 29–41. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000075
- Lienert, G. A., & Raatz, U. (1998). Testaufbau und Testanalyse. Beltz.
- Linnenluecke, M. K. (2017). Resilience in Business and Management Research: A Review of Influential Publications and a Research Agenda. International Journal of Management Reviews, 19(1), 4–30. https://doi.org/10.1111/ijmr.12076
- Macrotrends. (2024). Industrial Production – 100 Year Historical Chart [Dataset]. https://www.macrotrends.net/2583/industrial-production-historical-chart
- Meyer, C. (2008). Betriebswirtschaftliche Kennzahlen und Kennzahlen-Systeme. Verl. Wissenschaft & Praxis.
- Munoz, A., Billsberry, J., & Ambrosini, V. (2022). Resilience, robustness, and antifragility: Towards an appreciation of distinct organizational responses to adversity. International Journal of Management Reviews, 24(2), 181-187. https://doi.org/10.1111/ijmr.12289
- Najarian, M., & Lim, G. J. (2019). Design and Assessment Methodology for System Resilience Metrics. Risk Analysis: An Official Publication of the Society for Risk Analysis, 39(9), 1885–1898. https://doi.org/10.1111/risa.13274
- Nan, C., & Sansavini, G. (2017). A quantitative method for assessing resilience of interdependent infrastructures. Reliability Engineering & System Safety, 157, 35–53. https://doi.org/10.1016/j.ress.2016.08.013
- Norman, G. (2010). Likert scales, levels of measurement and the “laws” of statistics. Advances in Health Sciences Education, 15(5), 625–632. https://doi.org/10.1007/s10459-010-9222-y
- Pfanzagl, J. (1971). Theory of measurement. Physica.
- Portuguez Castro, M., & Gómez Zermeño, M. G. (2021). Being an entrepreneur post-COVID-19 – resilience in times of crisis: A systematic literature review. Journal of Entrepreneurship in Emerging Economies, 13(4), 721–746. https://doi.org/10.1108/JEEE-07-2020-0246
- Proag, V. (2014). Assessing and Measuring Resilience. Procedia Economics and Finance, 18, 222–229. https://doi.org/10.1016/S2212-5671(14)00934-4
- Reghezza-Zitt, M. (2021). Is Resilience Measurable? In É. Laurent (Ed.), The well-being transition: Analysis and policy (pp. 255–270). Palgrave Macmillan. https://doi.org/10.1007/978-3-030-67860-9_14
- Rose, A. (2004). Defining and measuring economic resilience to disasters. Disaster Prevention and Management: An International Journal, 13(4), 307–314. https://doi.org/10.1108/09653560410556528
- Rose, A. (2009). Economic resilience to disasters (CARRI Research Report 8). Community and Regional Resilience Institute. https://text2fa.ir/wp-content/uploads/Text2fa.ir-Economic-Resilience-to-Disasters-1.pdf
- Rossiter, J. R. (2002). The C-OAR-SE procedure for scale development in marketing. International Journal of Research in Marketing, 19(4), 305–335. https://doi.org/10.1016/S0167-8116(02)00097-6
- Rossiter, J. R. (2008). Content Validity of Measures of Abstract Constructs in Management and Organizational Research. British Journal of Management, 19(4), 380–388. https://doi.org/10.1111/j.1467-8551.2008.00587.x
- Ruiz-Martín, C. (2018). A framework to study the resilience of organizations: A case study of a nuclear emergency plan. Universidad de Valladolid. https://doi.org/10.35376/10324/29497
- Ruiz-Martín, C., Lopez-Paredes, A., & Wainer, G. (2018). What we know and do not know about organizational resilience. International Journal of Production Management and Engineering, 6(1), 11–28. https://doi.org/10.4995/ijpme.2018.7898
- Saad, M. H., Hagelaar, G., van der Velde, G., & Omta, S. W. F. (2021). Conceptualization of SMEs’ business resilience: A systematic literature review. Cogent Business & Management, 8(1), 1938347. https://doi.org/10.1080/23311975.2021.1938347
- Sanchis, R., & Poler, R. (2019). Origins of Disruptions Sources Framework to Support the Enterprise Resilience Analysis. IFAC-PapersOnLine, 52(13), 2062–2067. https://doi.org/10.1016/j.ifacol.2019.11.509
- Schäffer, U. (2020). Levers of Organizational Resilience. Controlling & Management Review, 64(6–7), 8–19. https://doi.org/10.1007/s12176-020-0133-3
- Schneeweiß, H. (1963). Nutzenaxiomatik und Theorie des Messens. Statistische Hefte, 4(1), 178–220. https://doi.org/10.1007/BF02923048
- Schötz, E. (2024). An Axiomatic Approach to Evaluating Measures of Firm Resilience. ENTRENOVA - ENTerprise REsearch InNOVAtion, 10(1), 84–95. https://doi.org/10.54820/entrenova-2024-0009
- Sheffi, Y., & Rice, J. B., Jr. (2005). A Supply Chain View of the Resilient Enterprise. MIT Sloan Management Review, 47(1), 41–48.
- Shepherd, D. A., & Suddaby, R. (2017). Theory Building: A Review and Integration. Journal of Management, 43(1), 59-86. https://doi.org/10.1177/0149206316647102
- Tolner, F., Eigner, G., & Barta, B. (2021). Resilience Interpretations of Small and Mediumsized Enterprises and its Analytical Approaches – Literature Review. IEEE 19th World Symposium on Applied Machine Intelligence and Informatics : Proceedings, 495–500. https://doi.org/10.1109/SAMI50585.2021.9378637
- Wacker, J. G. (2004). A theory of formal conceptual definitions: Developing theory-building measurement instruments. Journal of Operations Management, 22(6), 629–650. https://doi.org/10.1016/j.jom.2004.08.002
- Whitman, Z. R., Kachali, H., Roger, D., Vargo, J., & Seville, E. (2013). Short-form version of the Benchmark Resilience Tool (BRT-53). Measuring Business Excellence, 17(3), 3–14. https://doi.org/10.1108/MBE-05-2012-0030
- Yarveisy, R., Gao, C., & Khan, F. (2020). A simple yet robust resilience assessment metrics. Reliability Engineering & System Safety, 197, 106810. https://doi.org/10.1016/j.ress.2020.106810
- Zobel, C. W., & Khansa, L. (2014). Characterizing multi-event disaster resilience. Computers & Operations Research, 42, 83–94. https://doi.org/10.1016/j.cor.2011.09.024
Language: English
Page range: 57 - 76
Submitted on: Dec 14, 2024
Accepted on: Sep 5, 2025
Published on: May 10, 2026
In partnership with: Paradigm Publishing Services
Publication frequency: 2 issues per year
Related subjects:
© 2026 Enrico Schötz, published by IRENET - Society for Advancing Innovation and Research in Economy
This work is licensed under the Creative Commons Attribution 4.0 License.