What Works for whom in which Circumstances? An Integrated Realist Evaluation Model for Organisational Interventions
By: Hamid Roodbari, Karina Nielsen and Carolyn Axtell
References
- Abildgaard, J. S., Nielsen, K., & Sverke, M. (2018). Can job insecurity be managed? Evaluating an organizational-level intervention addressing the negative effects of restructuring. Work & Stress, 32(2), 105–123. DOI: 10.1080/02678373.2017.1367735
- Abildgaard, J. S., Nielsen, K., Wåhlin-Jacobsen, C. D., Maltesen, T., Christensen, K. B., & Holtermann, A. (2020). ‘Same, but different’: A mixed-methods realist evaluation of a cluster-randomized controlled participatory organizational intervention. Human Relations, 73(10), 1339–1365. DOI: 10.1177/0018726719866896
- Albertsen, K., Garde, A. H., Nabe-Nielsen, K., Hansen, Å. M., Lund, H., & Hvid, H. (2014). Work-life balance among shift workers: Results from an intervention study about self-rostering. International Archives of Occupational and Environmental Health, 87(3), 265–274. DOI: 10.1007/s00420-013-0857-x
- Augustsson, H., von Thiele Schwarz, U., Stenfors-Hayes, T., & Hasson, H. (2015). Investigating variations in implementation fidelity of an organizational-level occupational health intervention. International Journal of Behavioral Medicine, 22(3), 345–355. DOI: 10.1007/s12529-014-9420-8
- Bourbonnais, R., Brisson, C., Vinet, A., Vézina, M., & Lower, A. (2006). Development and implementation of a participative intervention to improve the psychosocial work environment and mental health in an acute care hospital. Occupational and Environmental Medicine, 63(5), 326–334. DOI: 10.1136/oem.2004.018069
- Brakenridge, C. L., Healy, G. N., Hadgraft, N. T., Young, D. C., & Fjeldsoe, B. S. (2018). Australian employee perceptions of an organizational-level intervention to reduce sitting. Health Promotion International, 33(6), 968–979. DOI: 10.1093/heapro/dax037
- Busch, C., Koch, T., Clasen, J., Winkler, E., & Vowinkel, J. (2017). Evaluation of an organizational health intervention for low-skilled workers and immigrants. Human Relations, 70(8), 994–1016. DOI: 10.1177/0018726716682308
- Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015). What’s in a mechanism? Development of a key concept in realist evaluation. Implementation Science, 10(1), 49. DOI: 10.1186/s13012-015-0237-x
- DeJoy, D. M., Wilson, M. G., Vandenberg, R. J., McGrath-Higgins, A. L., & Griffin-Blake, C. S. (2010). Assessing the impact of healthy work organization intervention. Journal of Occupational and Organizational Psychology, 83(1), 139–165. DOI: 10.1348/096317908X398773
- EU-OSHA. (2016). Second European Survey of Enterprises on New and Emerging Risks (ESENER-2). Overview Report: Managing Safety and Health at Work. Publications Office of the European Union.
https://op.europa.eu/s/n7Wt - Fox, K. E., Johnson, S. T., Berkman, L. F., Sianoja, M., Soh, Y., Kubzansky, L. D., & Kelly, E. L. (2022). Organisational- and group-level workplace interventions and their effect on multiple domains of worker well-being: A systematic review. Work & Stress, 36(1), 30–59. DOI: 10.1080/02678373.2021.1969476
- Framke, E., & Sørensen, O. H. (2015). Implementation of a participatory organisational-level occupational health intervention: focusing on the primary task. International Journal of Human Factors and Ergonomics, 3(3/4), 254. DOI: 10.1504/IJHFE.2015.072998
- Framke, E., Sørensen, O. H., Pedersen, J., Clausen, T., Borg, V., & Rugulies, R. (2019). Effect of a participatory organizational workplace intervention on workplace social capital: Post-hoc results from a cluster randomized controlled trial. BMC Public Health, 19(1), 693. DOI: 10.1186/s12889-019-6903-1
- Fridrich, A., Jenny, G. J., & Bauer, G. F. (2015). The context, process, and outcome evaluation model for organisational health interventions. BioMed Research International, 1–12. DOI: 10.1155/2015/414832
- Gaglio, B., Shoup, J. A., & Glasgow, R. E. (2013). The RE-AIM Framework: A systematic review of use over time. American Journal of Public Health, 103(6), e38–e46. DOI: 10.2105/AJPH.2013.301299
- Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., Ory, M. G., & Estabrooks, P. A. (2019). RE-AIM Planning and Evaluation Framework: Adapting to new science and practice with a 20-year review. Frontiers in Public Health, 7, 64. DOI: 10.3389/fpubh.2019.00064
- Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: the RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327. DOI: 10.2105/AJPH.89.9.1322
- Greenhalgh, T., Pawson, R., Wong, G., Westhorp, G., Greenhalgh, J., Manzano, A., & Jagosh, J. (2017). Retroduction in realist evaluation The RAMESES II Project. The RAMESES Projects.
www.ramesesproject.org - Gupta, N., Wåhlin-Jacobsen, C. D., Abildgaard, J. S., Henriksen, L. N., Nielsen, K., & Holtermann, A. (2018). Effectiveness of a participatory physical and psychosocial intervention to balance the demands and resources of industrial workers: A cluster-randomized controlled trial. Scandinavian Journal of Work, Environment & Health, 44(1), 58–68. DOI: 10.5271/sjweh.3689
- Hasson, H., Tafvelin, S., & von Thiele Schwarz, U. (2013). Comparing employees and managers’ perceptions of organizational learning, health, and work performance. Advances in Developing Human Resources, 15(2), 163–176. DOI: 10.1177/1523422313475996
- Holman, D., & Axtell, C. (2016). Can job redesign interventions influence a broad range of employee outcomes by changing multiple job characteristics? A quasi-experimental study. Journal of Occupational Health Psychology, 21(3), 284–295. DOI: 10.1037/a0039962
- ILO. (2001). Guidelines on occupational safety and health management systems, ILO-OSH. International Labor Office.
- Jenny, G. J., Brauchli, R., Inauen, A., Füllemann, D., Fridrich, A., & Bauer, G. F. (2015). Process and outcome evaluation of an organizational-level stress management intervention in Switzerland. Health Promotion International, 30(3), 573–585. DOI: 10.1093/heapro/dat091
- Karanika-Murray, M., & Biron, C. (2013).
The nature of change in organizational health interventions: Some observations and propositions . G. F. Bauer & G. J. Jenny (Eds.), Salutogenic organizations and change (pp. 239–258). Springer Netherlands. DOI: 10.1007/978-94-007-6470-5_13 - Lacouture, A., Breton, E., Guichard, A., & Ridde, V. (2015). The concept of mechanism from a realist approach: A scoping review to facilitate its operationalization in public health program evaluation. Implementation Science, 10(1), 153. DOI: 10.1186/s13012-015-0345-7
- Lemire, S., Kwako, A., Nielsen, S. B., Christie, C. A., Donaldson, S. I., & Leeuw, F. L. (2020). What is this thing called a mechanism? Findings from a review of realist evaluations. New Directions for Evaluation, 2020(167), 73–86. DOI: 10.1002/ev.20428
- Linnan, L., & Steckler, A. (2002).
Process evaluation for public health interventions and research: an overview . A. Linnan, & L. Steckler (Eds.), Process Evaluation for Public Health Interventions and Research (pp. 1–24). Jossey-Bass. - Lundmark, R., Hasson, H., von Thiele Schwarz, U., Hasson, D., & Tafvelin, S. (2017). Leading for change: Line managers’ influence on the outcomes of an occupational health intervention. Work & Stress, 31(3), 276–296. DOI: 10.1080/02678373.2017.1308446
- Marchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012). Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation, 18(2), 192–212. DOI: 10.1177/1356389012442444
- Montano, D., Hoven, H., & Siegrist, J. (2014). Effects of organisational-level interventions at work on employees’ health: A systematic review. BMC Public Health, 14(1), 135. DOI: 10.1186/1471-2458-14-135
- Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020). Ten recommendations for using implementation frameworks in research and practice. Implementation Science Communications, 1(1), 42. DOI: 10.1186/s43058-020-00023-7
- Murta, S. G., Sanderson, K., & Oldenburg, B. (2007). Process evaluation in occupational stress management programs: A systematic review. American Journal of Health Promotion, 21(4), 248–254. DOI: 10.4278/0890-1171-21.4.248
- Nielsen, K. (2013). Review Article: How can we make organizational interventions work? Employees and line managers as actively crafting interventions. Human Relations, 66(8), 1029–1050. DOI: 10.1177/0018726713477164
- Nielsen, K., & Abildgaard, J. S. (2013). Organizational interventions: A research-based framework for the evaluation of both process and effects. Work & Stress, 27(3), 278–297. DOI: 10.1080/02678373.2013.812358
- Nielsen, K., Abildgaard, J. S., & Daniels, K. (2014). Putting context into organizational intervention design: Using tailored questionnaires to measure initiatives for worker well-being. Human Relations, 67(12), 1537–1560. DOI: 10.1177/0018726714525974
- Nielsen, K., De Angelis, M., Innstrand, S. T., & Mazzetti, G. (2022). Quantitative process measures in interventions to improve employees’ mental health: A systematic literature review and the IPEF framework. Work & Stress, 1–26. DOI: 10.1080/02678373.2022.2080775
- Nielsen, K., & Miraglia, M. (2017). What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research. Human Relations, 70(1), 40–62. DOI: 10.1177/0018726716670226
- Nielsen, K., Nielsen, M. B., Ogbonnaya, C., Känsälä, M., Saari, E., & Isaksson, K. (2017b). Workplace resources to improve both employee well-being and performance: A systematic review and meta-analysis. Work & Stress, 31(2), 101–120. DOI: 10.1080/02678373.2017.1304463
- Nielsen, K., & Noblet, A. (2018).
Organizational interventions: Where are we, where do we go from here? In K. Nielsen & A. Noblet (Eds.), Organizational Interventions for Health and Well-Being: A Handbook for Evidence-Based Practice; (pp. 1–23). Routledge. DOI: 10.4324/9781315410494-1 - Nielsen, K., & Randall, R. (2012). The importance of employee participation and perceptions of changes in procedures in a teamworking intervention. Work & Stress, 26(2), 91–111. DOI: 10.1080/02678373.2012.682721
- Nielsen, K., & Randall, R. (2013). Opening the black box: Presenting a model for evaluating organizational-level interventions. European Journal of Work and Organizational Psychology, 22(5), 601–617. DOI: 10.1080/1359432X.2012.690556
- Nielsen, K., Randall, R., & Christensen, K. B. (2010a). Does training managers enhance the effects of implementing team-working? A longitudinal, mixed methods field study. Human Relations, 63(11), 1719–1741. DOI: 10.1177/0018726710365004
- Nielsen, K., Randall, R., & Christensen, K. B. (2017a). Do different training conditions facilitate team implementation? A quasi-experimental mixed methods study. Journal of Mixed Methods Research, 11(2), 223–247. DOI: 10.1177/1558689815589050
- Nielsen, K., Randall, R., Holten, A.-L., & González, E. R. (2010b). Conducting organizational-level occupational health interventions: What works? Work & Stress, 24(3), 234–259. DOI: 10.1080/02678373.2010.515393
- Nielsen, S. B., Lemire, S., & Tangsig, S. (2022). Unpacking context in realist evaluations: Findings from a comprehensive review. Evaluation, 28(1), 91–112. DOI: 10.1177/13563890211053032
- Oude Hengel, K. M., Blatter, B. M., Joling, C. I., van der Beek, A. J., & Bongers, P. M. (2012). Effectiveness of an intervention at construction worksites on work engagement, social support, physical workload, and need for recovery: Results from a cluster randomized controlled trial. BMC Public Health, 12(1), 1008. DOI: 10.1186/1471-2458-12-1008
- Pawson, R. (2013). The science of evaluation: A realist Manifesto (1st ed.). SAGE. DOI: 10.4135/9781473913820
- Pawson, R., & Tilley, N. (1997). Realistic evaluation (1st ed.). Sage Publications Ltd.
- Pawson, R., & Tilley, N. (2004). Realist evaluation.
http://www.communitymatters.com.au/RE_chapter.pdf - Roodbari, H., Axtell, C., Nielsen, K., & Sorensen, G. (2021). Organisational interventions to improve employees’ health and wellbeing: A realist synthesis. Applied Psychology, 71(3), 1–24. DOI: 10.1111/apps.12346
- Schelvis, R. M. C., Wiezer, N. M., Blatter, B. M., van Genabeek, J. A. G. M., Oude Hengel, K. M., Bohlmeijer, E. T., & van der Beek, A. J. (2016). Evaluating the implementation process of a participatory organizational level occupational health intervention in schools. BMC Public Health, 16(1), 1212. DOI: 10.1186/s12889-016-3869-0
- Sørensen, O. H. (2016). Improving the primary task - Effects of implementation intensity on employee health and organizational performance. Journal of Organizational Effectiveness: People and Performance, 3(4), 343–359. DOI: 10.1108/JOEPP-02-2016-0017
- Sørensen, O. H., & Holman, D. (2014). A participative intervention to improve employee well-being in knowledge work jobs: A mixed-methods evaluation study. Work & Stress, 28(1), 67–86. DOI: 10.1080/02678373.2013.876124
- Tafvelin, S., von Thiele Schwarz, U., Nielsen, K., & Hasson, H. (2019). Employees’ and line managers’ active involvement in participatory organizational interventions: Examining direct, reversed, and reciprocal effects on well-being. Stress and Health, 35(1), 69–80. DOI: 10.1002/smi.2841
- Teddlie, C., & Tashakkori, A. (2009).
Foundations of mixed methods research: Integrating quantitatuve and qualitative approaches in the social and behavioural sciences . In Sage Publications, Inc. Sagamore Publishing. - von Thiele Schwarz, U., & Hasson, H. (2013).
Alignment for achieving a healthy organization . G. Bauer & J. G. Jenny (Eds.), Salutogenic organizations and change (pp. 107–125). Springer Netherlands. DOI: 10.1007/978-94-007-6470-5_7 - von Thiele Schwarz, U., Lundmark, R., & Hasson, H. (2016). The Dynamic Integrated Evaluation Model (DIEM): Achieving sustainability in organizational intervention through a participatory evaluation approach. Stress and Health, 32(4), 285–293. DOI: 10.1002/smi.2701
- von Thiele Schwarz, U., Nielsen, K. M., Stenfors-Hayes, T., & Hasson, H. (2017). Using kaizen to improve employee well-being: Results from two organizational intervention studies. Human Relations, 70(8), 966–993. DOI: 10.1177/0018726716677071
- Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4(1), 67. DOI: 10.1186/1748-5908-4-67
- Wong, G., Westhorp, G., Greenhalgh, J., Manzano, A., Jagosh, J., & Greenhalgh, T. (2017). Quality and reporting standards, resources, training materials and information for realist evaluation: The RAMESES II project. Health Services and Delivery Research, 5(28), 1–108. DOI: 10.3310/hsdr05280
DOI: https://doi.org/10.16993/sjwop.171 | Journal eISSN: 2002-2867
Language: English
Page range: 4 - 4
Submitted on: Dec 13, 2021
Accepted on: May 16, 2023
Published on: Jun 13, 2023
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services
Keywords:
© 2023 Hamid Roodbari, Karina Nielsen, Carolyn Axtell, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.