Skip to main content
Have a personal or library account? Click to login
Testing Longitudinal Measurement Invariance of the Dutch PSS-10, MBI-ES, and PANAS in a Bimonthly 6-Month Panel Cover

Testing Longitudinal Measurement Invariance of the Dutch PSS-10, MBI-ES, and PANAS in a Bimonthly 6-Month Panel

Open Access
|May 2026

Figures & Tables

Figure 1

Confirmatory Factor Analysis of Construct η at time points A and B, with Indicators yi, Factor Loadings λi, Item Intercepts τi, and Item Error Variances Var(ɛi).

Note. A and B refer to two time points. To avoid clutter, the covariances between the latent variables and between the time-specific observations of the items are not displayed.

Table 1

Studies Investigating the LMI of the PSS-10, MBI, and PANAS.

FIRST AUTHOR, YEAR OF PUBLICATION, TITLESCALE VERSIONPOPULATION AND LOCATIONDESIGNNLMI LEVELS TESTEDLMI LEVELS SUPPORTED
Jiang et al. (2023): Validation of the Chinese version of the Perceived Stress Scale-10 integrating exploratory graph analysis and confirmatory factor analysisPSS-10, ChineseUniversity students, China2 waves, 1-week interval492Configural
Metric
Scalar
Residual
Configural
Metric
Scalar
Residual
Reis et al. (2019): The German Version of the Perceived Stress Scale (PSS-10): Evaluation of Dimensionality, Validity, and Measurement Invariance With Exploratory and Confirmatory Bifactor ModelingPSS-10, GermanAdult participants of six RCTs testing the same stress management training, Germany2 waves, 8-week interval1862Configural
Metric
Scalar
Configural
Metric
Scalar
Isik Akin et al. (2024): Parent-Child Relationship, Well-Being and Home-Leaving during the Transition from High School to UniversityPSS-10, TurkishUniversity students, Turkey2 waves, 18-month interval240Configural
Metric
Scalar
Configural
Metric
Scalar
Shields et al. (2016): Stress-related changes in personality: A longitudinal study of perceived stress and trait pessimismPSS-10, EnglishYoung, middle, and older adults from college campuses and surrounding community, USA5 waves, 1-week intervals332Configural
Metric
Scalar
Configural
Metric
Scalar
Barbosa-Leiker et al. (2013): Measurement Invariance of the Perceived Stress Scale and Latent Mean Differences across Gender and TimePSS-10, EnglishParticipants of the Spokane Heart Study: asymptomatic, community-dwelling adults, USA2 waves, 2-year interval871Configural
Metric
Scalar
Configural
Metric
Scalar
Turhan et al. (2021): Psychometric Properties of the German Short Version of the Maslach Burnout Inventory - Student SurveyMBI short student version, GermanUniversity students, Germany3 waves, 6-week intervals1435Configural
Metric
Scalar
Residual
Configural
Metric
Scalar
Residual
Giusti et al. (2022): The North Italian Longitudinal Study Assessing the Mental Health Effects of SARS-CoV-2 Pandemic Health Care Workers—Part II: Structural Validity of Scales Assessing Mental Health.MBI, ItalianUniversity hospital staff, Italy2 waves, 16-month interval369Configural
Metric
Scalar
Configural
Metric
Kim et al. (2009): Factor Structure and Longitudinal Invariance of the Maslach Burnout InventoryMBI, EnglishSocial workers, USA2 waves, 1-year interval282Configural
Metric
Configural
Metric (partial)
Mäkikangas et al. (2011): Longitudinal factorial invariance of the Maslach Burnout Inventory-General Survey among employees with job-related psychological health problemsMBI, FinnishEmployees who participated in two different rehabilitation intervention programs, Finland2 waves, 4-month interval155Configural
Metric
Residual
Configural
Metric
Residual
Schnitker et al. (2020): Bidirectional associations across time between entitativity, positive affect, generosity, and religiousness in adolescents training with a religiously affiliated charity marathon teamPANAS adapted for children, EnglishAdolescents and emerging adults from running teams, USA3 waves, 15-week interval between T1 and T2, 3-week interval between T2 and T3396Configural
Metric
Scalar
Configural
Metric
Scalar
Jønsson et al. (2022): The savvy and cheerful employee innovation champions: The roles of political skill and trait-positive affect in employees’ championing and salary levelsPositive affect items of the PANAS short form, DanishEmployees from a branch of a global IT consultancy company, Denmark3 waves, 4-month intervals152Configural
Metric
Scalar
Configural
Metric
Scalar
Belkin et al. (2022): Beliefs in government benevolence can promote individuals’ compliance with government-issued guidelines: The role of positive affect and general construal levelPositive affect items of the PANAS short form, EnglishAdult Mechanical Turk participants, USA2 waves, 2-week interval195Configural
Metric
Scalar
Configural
Metric
Scalar
Xiang et al. (2023): Development of self-concept clarity from ages 11 to 24: Latent growth models of Chinese adolescentsPositive Affect subscale of the PANAS, ChineseAdolescents, China3 waves, 6-month intervals2001Configural
Metric
Scalar
Configural
Metric
Table 2

Means, Standard Deviations, Range, and Reliabilities for all Scales at T1, T2, and T3.

SCALET1T2T3
M(SD)RANGEωM(SD)RANGEωM(SD)RANGEω
PSS a2.72(0.64)1–50.902.65(0.59)1–50.892.55(0.71)1–50.94
EEX a2.71(0.84)1–50.892.65(0.83)1–50.902.58(0.88)1–50.91
NA b2.55(0.62)1–50.802.49(0.66)1–50.852.38(0.68)1–50.86
PA b3.40(0.57)1–50.873.45(0.55)1–50.873.49(0.62)1–50.90

[i] Note. PSS = Perceived Stress Scale; EEX = Maslach Burnout Inventory, Educators Survey, Emotional Exhaustion subscale; NA = PANAS, Negative Affect subscale; PA = PANAS, Positive Affect subscale; ω = McDonald’s omega.

a N for PSS and EEX = 237.

b N for NA and PA = 236.

Table 3

Goodness-of-Fit Statistics for the Confirmatory Factor Analyses testing the Unidimensional Structure of all Scales, T1.

SCALEχ2 (df)pRMSEA [90% CI]SRMRCFI
PSS a91.57 (35)<0.0010.083 [0.062, 0.103]0.0400.948
EEX a87.45 (27)<0.0010.097 [0.075, 0.120]0.0410.939
NA b62.02 (27)<0.0010.074 [0.050, 0.099]0.0540.949
PA b78.01 (26)<0.0010.092 [0.069, 0.116]0.0450.939

[i] Note. PSS = Perceived Stress Scale; EEX = Maslach Emotional Exhaustion subscale; NA = PANAS Negative Affect subscale; PA = PANAS Positive Affect subscale; df = degrees of freedom; RMSEA = root mean square error of approximation; CI = confidence interval; SRMR = standardized root mean square residual; CFI = comparative fit index.

a N for PSS and EEX = 237.

b N for NA and PA = 236.

Table 4

Model Fit Indices for the Longitudinal Configural, Metric, Scalar, Residual, and Partial Residual Invariant Models for Perceived Stress Scale (PSS-10).

LEVELGOODNESS-OF-FITMODEL COMPARISON
χ2 (df) PRMSEA [90% CI]SRMRCFIREF. MODELΔχ2df) PΔRMSEAΔSRMRΔCFI
Configural598.36 (372) ***0.051 [0.043, 0.058]0.0650.916
Metric615.90 (390) ***0.049 [0.042, 0.057]0.0740.916Configural17.54 (18) n.s.–0.002+0.009+0.000
Scalar634.83 (408) ***0.048 [0.041, 0.056]0.0740.916Metric18.93 (18) n.s.–0.001+0.000+0.000
Residual685.18 (428) ***0.050 [0.043, 0.057]0.0930.905Scalar50.34 (20) ***+0.002+0.019–0.011
Partial residual655.82 (422) ***0.048 [0.041, 0.055]0.0830.913Scalar20.99 (14) n.s.+0.000+0.009–0.003

[i] Note. df = degrees of freedom; RMSEA = root mean square error of approximation; CI = confidence interval; SRMR = standardized root mean square residual; CFI = comparative fit index; Ref. model = reference model; N = 237.

*** p < 0.001; n.s. = not significant.

Table 5

Model Fit Indices for the Longitudinal Configural, Metric, Scalar, and Residual Invariant Models for Maslach Burnout Inventory, Educators Survey (MBI-ES), Emotional Exhaustion subscale.

LEVELGOODNESS-OF-FITMODEL COMPARISON
χ2(df) PRMSEA [90% CI]SRMRCFIREF. MODELΔχ2df) PΔRMSEAΔSRMRΔCFI
Configural483.15 (294) ***0.052 [0.044, 0.060]0.0690.923
Metric496.43 (310) ***0.050 [0.042, 0.058]0.0740.925Configural13.28 (16) n.s.–0.002+0.005+0.002
Scalar521.32 (326) ***0.050 [0.042, 0.058]0.0760.921Metric24.89 (16) n.s.+0.000+0.002–0.004
Residual540.63 (344) ***0.049 [0.041, 0.057]0.0820.920Scalar19.30 (18) n.s.–0.001+0.006–0.001

[i] Note. df = degrees of freedom; RMSEA = root mean square error of approximation; CI = confidence interval; SRMR = standardized root mean square residual; CFI = comparative fit index; Ref. model = reference model; N = 237.

*** p < 0.001; n.s. = not significant.

Table 6

Model Fit Indices for the Longitudinal Configural, Metric, Scalar, and Residual Invariant Models Positive and Negative Affect Schedule (PANAS), Negative Affect subscale.

LEVELGOODNESS-OF-FITMODEL COMPARISON
χ2(df) PRMSEA [90% CI]SRMRCFIREF. MODELΔχ2df) PΔRMSEAΔSRMRΔCFI
Configural557.11 (348) ***0.050 [0.043, 0.058]0.0850.895
Metric579.46 (366) ***0.050 [0.042, 0.057]0.0920.893Configural22.35 (18)n.s.+0.000+0.007–0.002
Scalar612.71 (384) ***0.050 [0.042, 0.057]0.0930.885Metric33.25 (18) *+0.000+0.001–0.008
Partial scalar602.66 (380) ***0.050 [0.042, 0.057]0.0930.888Metric23.21 (14) n.s.+0.000+0.001–0.005
Residual621.62 (400) ***0.048 [0.041, 0.056]0.0970.889Partial scalar18.96 (20) n.s.–0.002+0.004+0.001

[i] Note. df = degrees of freedom; RMSEA = root mean square error of approximation; CI = confidence interval; SRMR = standardized root mean square residual; CFI = comparative fit index; Ref model = reference model; N = 236.

*** p < 0.001; * p < 0.05; n.s. = not significant.

Table 7

Model Fit Indices for the Longitudinal Configural, Metric, Scalar, and Residual Invariant Models Positive and Negative Affect Schedule (PANAS), Positive Affect subscale.

LEVELGOODNESS-OF-FITMODEL COMPARISON
χ2(df) PRMSEA [90% CI]SRMRCFIREF. MODELΔχ2df) PΔRMSEAΔSRMRΔCFI
Configural601.62 (345) ***0.056 [0.049, 0.064]0.0820.887
Metric619.28 (363) ***0.055 [0.047, 0.062]0.0900.887Configural17.67 (18) n.s.–0.001+0.008+0.000
Scalar635.63 (381) ***0.053 [0.046, 0.060]0.0910.888Metric16.35 (18) n.s.–0.002+0.001+0.001
Residual651.02 (401) ***0.051 [0.044, 0.058]0.0930.890Scalar15.39 (20) n.s.–0.002+0.002+0.002

[i] Note. df = degrees of freedom; RMSEA = root mean square error of approximation; CI = confidence interval; SRMR = standardized root mean square residual; CFI = comparative fit index; Ref model = reference model; N = 236.

*** p < 0.001; n.s. = not significant.

DOI: https://doi.org/10.5334/pb.1528 | Journal eISSN: 0033-2879
Language: English
Page range: 65 - 80
Submitted on: Mar 27, 2026
Accepted on: May 4, 2026
Published on: May 25, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2026 Justine Van de Velde, Bert Weijters, Katia Levecque, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.