Skip to main content
Have a personal or library account? Click to login
Development and Validation of an Instrument to Measure Work-Related Learning Cover

Development and Validation of an Instrument to Measure Work-Related Learning

Open Access
|Apr 2020

Figures & Tables

Table 1

Sample Characteristics.

T1T2
(N = 3232)(N = 1878)
Gender
      Male1292 (40.0%)781 (41.6%)
      Female1875 (58.0%)1085 (57.8%)
      No information65 (2.0%)12 (0.6%)
Age
      Mean37.5437.77
      Standard Deviation12.9713.19
      Minimum–Maximum18–6720–66
Highest obtained degree in education
      Higher education2077 (64.3%)1210 (64.6%)
      Secondary education1032 (31.9%)622 (33.1%)
      Primary education49 (1.5%)30 (1.6%)
      No information74 (2.3%)16 (0.9%)
Type of contract
      Permanent2627 (81.3%)1531 (81.5%)
      Temporary600 (16.3%)343 (18.3%)
      No information5 (0.1%)4 (0.2%)
Working hours
      Full time2471 (76.5%)1443 (76.8%)
      Part time761 (23.5%)435 (23.2%)
      No information0 (0.0%)0 (0.0%)
Sector
      Profit1024 (31.7%)561 (29.9%)
      Non-profit2208 (68.3%)1316 (70.0%)
      No information0 (0.0%)1 (0.1%)
Occupational position
      Blue-collar workers265 (8.2%)154 (8.2%)
      White-collar workers2076 (64.2%)1184 (63.0%)
      Management100 (3.1%)49 (2.6%)
      No information791 (24.5%)491 (26.1%)
Number of employees within organization
      0–49 employees557 (17.9%)329 (17.5%)
      50–249 employees545 (16.9%)286 (15.2%)
      250–999 employees389 (12.0%)220 (11.7%)
      1000 employees or more1721 (53.2%)1043 (55.5%)
      No information0 (0.0%)0 (0.0%)
Years of total work experience
      Mean14.5514.68
      Standard Deviation13.1513.35
      Minimum–Maximum0–470–46

[i] Note: This table demonstrates sample characteristics of the samples described in step 2 (questionnaire administration) and step 6 (retesting the structure and assessing the instrument over time).

Table 2

Results Exploratory Factor Analysis.

Item codeItemF1F2F3
Q7Observed how others managed things.0.860.060.03
Q10Asked the opinion of others on what I did.0.800.090.03
Q11Talked about work experiences with others.0.790.010.01
Q6Thought about how I handled things.0.71–0.09–0.04
Q12Thought about how I would handle things on beforehand.0.70–0.07–0.04
Q3Asked others for information.0.62–0.170.08
Q14Read magazines, websites, books, etc.–0.06–0.97–0.04
Q15Watched visual material (documentary films, instruction videos, etc.).0.00–0.700.09
Q1Searched for information (websites, magazines, videos, books, etc.).0.14–0.630.01
Q8Took part in a workshop.–0.10–0.020.81
Q4Took part in a seminar/conference.0.04–0.030.74
Q9Attended a presentation.0.06–0.050.69
Q5Attended a training/(additional) course.0.030.050.62

[i] Note: The second construct correlated negatively with the first and third construct. These negative loadings are due to the choice for oblique rotation and have no further implications (e.g., Bandalos, 2018).

Table 3

Confirmatory Factor Analysis.

ItemRegression weightStandard errorStandardized regression weightCritical ratioa
Informal learning activities using personal sources
Q71.00b0.82b
Q100.930.030.7632.95
Q110.950.030.7934.88
Q60.960.030.7532.48
Q120.910.030.7029.89
Q30.860.030.7130.19
Informal learning activities using environmental sources
Q141.00b0.87b
Q150.850.030.7932.58
Q10.780.030.7129.17
Formal learning activities
Q81.00b0.81b
Q41.010.030.7730.81
Q91.040.030.7730.93
Q50.890.040.6525.45

[i] Note: Estimation method: maximum likelihood.

a All critical ratios: p < 0.001.

b Value fixed at 1.00 for model identification purpose, hence no standard error was computed.

Table 4

Measurement Invariance across Groups.

GroupsModelχ2 (df)CFIRMSEABICModel comparisonΔχ2df)pΔCFI
Educational backgroundModel 1 (configural invariance)791.10 (186)0.9360.07965255
Model 2 (equal loadings)860.97 (206)0.9310.07865178Model 1 vs. Model 2 (metric invariance)69.86 (20)<0.0010.005
Model 3 (+equal intercepts)936.16 (226)0.9250.07765106Model 2 vs. Model 3 (scalar invariance)75.20 (20)<0.0010.006
SectorModel 1 (configural invariance)766.52 (124)0.9380.08067141
Model 2 (equal loadings)783.00 (134)0.9380.07767084Model 1 vs. Model 2 (metric invariance)16.49 (10)0.090.001
Model 3 (+equal intercepts)860.32 (144)0.9310.07867087Model 2 vs. Model 3 (scalar invariance)77.32 (10)<0.0010.006
Table 5

Correlation Coefficient Estimates for Relationships between Demographic Variables and Work-Related Learning (T1–T2).

MSDSquare Root AVE17.18.19.20.21.22.
1. Female0.590.490.14***–0.04*    0.01      0.18***–0.06*    –0.00      
2. Age37.5412.97–0.42***–0.14***–0.15***–0.44***–0.15***–0.13***
3. Higher education0.660.470.36***0.25***0.20***0.36***0.24***0.18***
4. Secondary education0.330.47–0.34***–0.23***–0.18***–0.34***–0.22***–0.15***
5. Primary education0.020.12–0.08***–0.08***–0.09***–0.09***–0.10***–0.03      
6. Permanent contract0.810.39–0.27***–0.15***–0.02      –0.29***–0.13***0.01      
7. Full time employment0.760.420.12***0.12***0.13***0.10***0.15***0.14***
8. Profit sector0.320.47–0.01      –0.08***–0.07***–0.04      –0.04      –0.05*    
9. Blue-collar workers0.110.31–0.19***–0.22***–0.18***–0.19***–0.18***–0.17***
10. White-collar worker0.830.370.11***0.12***0.08***0.12***0.10***0.10***
11. Management0.040.200.09***0.13***0.14***0.08***0.11***0.12***
12. Size: 0–49 employees0.260.440.06**    0.04      –0.09***0.11***0.09**    –0.06      
13. Size: 50–249 employees0.250.43–0.02      –0.00      –0.02      –0.02      –0.05      –0.00      
14. Size: 250–999 employees0.180.38–0.03      –0.03      –0.01      –0.07*    –0.08**    –0.02      
15. Size: 1000 employees or more0.320.46–0.01      –0.02      0.11***–0.03      0.02      0.08**    
16. Work experience14.5513.15–0.44***–0.17***–0.16***–0.45***–0.17***–0.14***
17. Informal learning personal sources – T14.141.310.75–      0.48***0.38***0.72***0.36***0.25***
18. Informal learning environmental sources – T13.641.540.79–      0.41***0.38***0.60***0.29***
19. Formal learning – T12.230.940.75–      0.25***0.31***0.56***
20. Informal learning personal sources – T24.191.260.75–      0.47***0.34***
21. Informal learning environmental sources – T23.691.490.78–      0.38***
22. Formal learning – T22.240.880.74      –      

[i] Note: * p < 0.05; ** p < 0.01; *** p < 0.001; AVE = Average Variance Extracted.

Table 6

Confirmatory Factor Analysis of the Second Measurement Moment.

ItemRegression weightStandard errorStandardized regression weightCritical ratioa
Informal learning activities using personal sources
Q71.00b0.82b
Q100.920.030.7635.85
Q110.950.030.7937.80
Q60.960.030.7535.33
Q120.880.030.7032.29
Q30.840.030.6931.91
Informal learning activities using environmental sources
Q141.00b0.86b
Q150.810.030.7731.97
Q10.780.030.6929.27
Formal learning activities
Q81.00b0.79b
Q41.000.030.7430.27
Q91.120.040.7831.65
Q50.910.040.6426.38

[i] Note: Estimation method: maximum likelihood.

a All critical ratios: p < 0.001.

b Value fixed at 1.00 for model identification purpose, hence no standard error was computed.

Table 7

Longitudinal Measurement Invariance.

ScaleModelχ2 (df)CFIRMSEABICModel comparisonΔχ2df)pΔCFI
Informal learning activities using personal sourcesModel 1558.53 (47)0.9630.07672076.24
Model 2 (equal loadings)559.92 (52)0.9630.07272039.95Model 1 vs. Model 21.39 (5)0.930.000
Model 3 (+equal intercepts)575.22 (57)0.9630.07072017.55Model 2 vs. Model 315.30 (5)0.0090.000
Informal learning activities using environmental sourcesModel 122.77 (5)0.9970.04439552.72
Model 2 (equal loadings)23.18 (7)0.9970.03539538.05Model 1 vs. Model 20.41 (2)0.810.000
Model 3 (+equal intercepts)29.53 (9)0.9960.03539529.32Model 2 vs. Model 36.35 (2)0.040.001
Formal learning activitiesModel 1207.99 (15)0.9700.08339930.47
Model 2 (equal loadings)209.79 (18)0.9700.07539909.66Model 1 vs. Model 21.800.610.000
Model 3 (+equal intercepts)211.33 (21)0.9710.06939761.22Model 2 vs. Model 31.540.67–0.001
Item in InstrumentReference(s)Exemplary original item
Q1Searched for information (websites, magazines, videos, books, etc.).Berg and Chyung 2008
Lohman 2006
Noe et al. (2013)
Search the web (including intranet).
Q2Tried something new (technique, method, behaviour, etc.).Berg and Chyung 2008
Lohman 2006
Kwakman 2003
Noe et al. (2013)
Experimenting with new ways of performing my work.
Q3Asked others for information.Berg and Chyung (2008)Ask questions in professional listservs.
Q4Took part in a seminar/conference.Blau et al. 2008
Lauber et al. (2010)
Attending conferences and symposia.
Q5Attended a training/(additional) course.Berg and Chyung 2008
Blau et al. 2008
Lauber et al. (2010)
Attend a training program.
Q6Thought about how I handled things.Berg and Chyung 2008
Kwakman 2003
Lohman 2006
Noe et al. (2013)
Reflect on your actions.
Q7Observed how others managed things.Berg and Chyung 2008
Kwakman 2003
Lohman (2006)
Observe others.
Q8Took part in a workshop.Blau et al. (2008)Workshops (e.g., customer service, laboratory testing).
Q9Attended a presentation.New item
Q10Asked the opinion of others on what I did.Kwakman (2003)Ask pupils’ feedback.
Q11Talked about work experiences with others.Berg and Chyung 2008
Kwakman 2003
Lauber et al. 2010
Lohman 2006
Noe et al. (2013)
Talk with other people at work face to face.
Q12Thought about how I would handle things on beforehand.New item
Q13Took an e-learning course (online training).New item
Q14Read magazines, websites, books, etc.Berg and Chyung 2008
Kwakman 2003
Lauber et al. 2010
Lohman 2006
Noe et al. (2013)
Reading professional magazines or vendor publications.
Q15Watched visual material (documentary films, instruction videos, etc.).New item

[i] Note: The items were measured on a 7-point Likert scale, ranging from: 1 ‘Never’, 2 ‘Rarely – Once or twice in the previous six months’, 3 ‘Occasionally – Monthly’, 4 ‘Often – A few times each month’, 5 ‘Very often – Weekly’, 6 ‘Very often – A few times each week’, to 7 ‘On a daily basis’.

DOI: https://doi.org/10.16993/sjwop.99 | Journal eISSN: 2002-2867
Language: English
Page range: 3 - 3
Submitted on: Aug 26, 2019
Accepted on: Feb 25, 2020
Published on: Apr 15, 2020
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services

© 2020 Ilke Grosemans, Kelly Smet, Ellen Houben, Nele De Cuyper, Eva Kyndt, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.