Table 1
Levels of educational outcomes from Kirkpatrick studies
|
Level |
Outcome |
Description |
|---|---|---|
|
1a |
Learner reaction |
Learners’ reactions to program (e.g., satisfaction with learning experience) |
|
2a |
Attitudinal changes |
Changes in learners’ attitudes and beliefs |
|
2b |
Knowledge or skill acquisition |
Acquisition of knowledge (e.g., concepts or principles), and/or skills |
|
3a |
Behavioural change |
Application of knowledge/skills in an educational or practice setting |
|
3b |
Learner achievements |
Learner academic and professional achievements (publications, presentations, awards, professional positions) |
|
4 |
Organizational or health systems change |
Changes in work units and institutions or in the operation and organization of health systems |
Table 2
Overview of central features of postgraduate leadership programs in medicine (n = 31)
|
Feature |
No. (%) |
|---|---|
|
Country | |
|
18 (58) | |
|
7 (22.6) | |
|
2 (6.5) | |
|
2 (6.5) | |
|
Germany [35] |
1 (3.2) |
|
Netherlands [49] |
1 (3.2) |
|
Education setting/program type | |
|
Formal integrated residency program [32, 33, 40, 44, 51, 54, 76, 82] |
8 (25.8) |
|
University-based course/elective programs [8, 35, 37, 39, 41, 43, 47–49, 52, 55] |
11 (35.9) |
|
Hospital/academic medical centre-based elective programs [2, 36, 38, 46, 53, 56] |
6 (19.4) |
|
4 (12.9) | |
|
Medical society/association program [81] |
1 (3.2) |
|
Unclear or unspecified [45] |
1 (3.2) |
|
Targeted learners/entry level | |
|
5 (16.1) | |
|
2 (6.5) | |
|
2 (6.5) | |
|
PGY4 [51] |
1 (3.2) |
|
8 (25.8) | |
|
4 (12.9) | |
|
Senior residents and fellows [39] |
1 (3.2) |
|
Residents (PGY4) and senior physicians [34] |
1 (3.2) |
|
Medical students residents and fellows [81] |
1 (3.2) |
|
6 (19.4) | |
|
Targeted learners/specialties | |
|
2 (6.5) | |
|
Multiple specialties [23, 34–36, 38, 41, 42, 44, 46, 49, 56, 76] |
12 (38.7) |
|
Multiple secondary care specialties [32] |
1 (3.2) |
|
Paediatrics [40] |
1 (3.2) |
|
Paediatric anaesthesia [37] |
1 (3.2) |
|
Pathology [39] |
1 (3.2) |
|
Primary care (general practice/family medicine) residents [33, 45, 47, 51, 54] |
5 (16.1) |
|
Psychiatry [48] |
1 (3.2) |
|
2 (6.5) | |
|
Neurosurgery [8] |
1 (3.2) |
|
2 (6.5) | |
|
2 (6.5) | |
|
aStructured multi-professional/management-clinician learning components [32, 44, 82] |
(3/31) |
|
Duration | |
|
Short-term interventions (1 day–1 month) [2, 35, 36, 38, 41, 53, 55] |
7 (22.6) |
|
Medium-term interventions (intermittent sessions or >1 month <1 year) [8, 39, 43, 47, 48, 52, 81] |
7 (22.6) |
|
Longitudinal interventions (intensive rotations or ≥1 year programs) [23, 32, 33, 37, 40, 42, 44, 49–51, 54, 56, 76, 82] |
14 (45.2) |
|
2 (6.5) | |
|
Unknown/not specified [45] |
1 (3.2) |
|
Credential | |
|
Certificate in Healthcare Management and Leadership [76] |
1 (3.2) |
|
Accredited postgraduate certificate [50] |
1 (3.2) |
|
Diploma in Health and Public Leadership [32] |
1 (3.2) |
|
MSc in Health and Public Leadership [32] |
1 (3.2) |
|
2 (6.5) | |
|
26 (83.9) | |
aOverlaps with other categories above
