Can We Improve the Assessment of Work Characteristics by Completely Contextualizing Items?
References
- Ajzen, I., & Fishbein, M. (1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84(5), 888–918. 10.1037/0033-2909.84.5.888
- Bing, M. N., Whanger, J. C., Davison, H. K., & VanHook, J. B. (2004). Incremental validity of the frame-of-reference effect in personality scale scores: A replication and extension. Journal of Applied Psychology, 89(1), 150–157. 10.1037/0021-9010.89.1.150
- Credé, M., Bashshur, M., & Niehorster, S. (2010). Reference group effects in the measurement of personality and attitudes. Journal of Personality Assessment, 92(5), 390–399. 10.1080/00223891.2010.497393
- Debus, M. E., Greulich, B., König, C. J., & Kleinmann, M. (2019). Insecure about how to rate your job insecurity? A two-study investigation into time frames applied to job insecurity measures. Occupational Health Science, 3(4), 421–435. 10.1007/s41542-019-00049-x
- Eatough, E. M., & Spector, P. E. (2013).
Quantitative self-report methods in occupational health psychology research . In M. Wang, R. Sinclair, & L. E. Tetrick (Eds.), Research methods in occupational health psychology: Measurement, design, and data analysis (pp. 248–267). Routledge. - Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11(1), 93–103. 10.1177/014662168701100107
- Fryers, T., Brugha, T., Morgan, Z., Smith, J., Hill, T., Carta, M., Lehtinen, V., & Kovess, V. (2004). Prevalence of psychiatric disorder in Europe: The potential and reality of meta-analysis. Social Psychiatry and Psychiatric Epidemiology, 39(11), 899–905. 10.1007/s00127-004-0875-9
- Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review, 18(4), 694–734. 10.2307/258595
- Goldberg, D. P., & Hillier, V. F. (1979). A scaled version of the General Health Questionnaire. Psychological Medicine, 9(1), 139–145. 10.1017/s0033291700021644
- Greulich, B., Debus, M. E., Kleinmann, M., & König, C. J. (2021). Response behavior in work stress surveys: A qualitative study on motivational and cognitive processes in self- and other-reports. European Journal of Work and Organizational Psychology, 30(1), 40–57. 10.1080/1359432X.2020.1812580
- Greulich, B., König, C. J., & Fischer, N. (2024). How relative is stress? The influence of social comparisons when responding to work stress surveys. Journal of Personnel Psychology, 23(1), 1–11. 10.1027/1866-5888/a000330
- Havermans, B. M., Brouwers, E. P. M., Hoek, R. J. A., Anema, J. R., van der Beek, A. J., & Boot, C. R. L. (2018). Work stress prevention needs of employees and supervisors. BMC Public Health, 18(1),
642 . 10.1186/s12889-018-5535-1 - Holtrop, D., Born, M. P., de Vries, A., & de Vries, R. E. (2014). A matter of context: A comparison of two types of contextualized personality measures. Personality and Individual Differences, 68, 234–240. 10.1016/j.paid.2014.04.029
- Holtrop, D., Born, M. P., & de Vries, R. E. (2014). Predicting performance with contextualized inventories, no frame-of-reference effect? International Journal of Selection and Assessment, 22(2), 219–223. 10.1111/ijsa.12071
- Holtz, B. C., Ployhart, R. E., & Dominguez, A. (2005). Testing the rules of justice: The effects of frame-of-reference and pre-test validity information on personality test responses and test perceptions. International Journal of Selection and Assessment, 13(1), 75–86. 10.1111/j.0965-075X.2005.00301.x
- Karasek, R. A. (1979). Job demands, job decision latitude, and mental strain: Implications for job redesign. Administrative Science Quarterly, 24(2), 285–308. 10.2307/2392498
- Kristensen, T. S., Hannerz, H., Høgh, A., & Borg, V. (2005). The Copenhagen Psychosocial Questionnaire—a tool for the assessment and improvement of the psychosocial work environment. Scandinavian Journal of Work, Environment & Health, 31(6), 438–449. 10.5271/sjweh.948
- Lautenschlager, G. J., & Meade, A. W. (2008). AlphaTest: A Windows program for tests of hypotheses about coefficient alpha. Applied Psychological Measurement, 32(6), 502–503. 10.1177/0146621607312307
- Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer.
- Lievens, F., De Corte, W., & Schollaert, E. (2008). A closer look at the frame-of-reference effect in personality scale scores and validity. Journal of Applied Psychology, 93(2), 268–279. 10.1037/0021-9010.93.2.268
- Linden, M., Maier, W., Achberger, M., Herr, R., Helmchen, H., & Benkert, O. (1996). Psychische Erkrankungen und ihre Behandlung in Allgemeinarztpraxen in Deutschland: Ergebnisse aus einer Studie der Weltgesundheitsorganisation (WHO) [Psychological disorders and their treatment in general practice in Germany: Results of a WHO study.]. Der Nervenarzt, 67(3), 205–215.
- Nübling, M., Stößel, U., Hasselhorn, H. M., Michaelis, M., & Hofmann, F. (2005). Methoden zur Erfassung psychischer Belastungen: Erprobung eines Messinstrumentes (COPSOQ) [Methods for recording mental stress: Testing of a measuring instrument (COPSOQ)]. Wirtschaftsverlag NW.
- Reddock, C. M., Biderman, M. D., & Nguyen, N. T. (2011). The relationship of reliability and validity of personality tests to frame-of-reference instructions and within-person inconsistency. International Journal of Selection and Assessment, 19(2), 119–131. 10.1111/j.1468-2389.2011.00540.x
- Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040–2068. 10.1037/apl0000994
- Schlotzhauer, A. E., Ng, M. A., & Su, S. (2025). How to frame the frame of reference: A comparison of contextualization methods. Journal of Business and Psychology, 40(2), 385–403. 10.1007/s10869-024-09953-8
- Schmit, M. J., Ryan, A. M., Stierwalt, S. L., & Powell, A. B. (1995). Frame-of-reference effects on personality scale scores and criterion-related validity. Journal of Applied Psychology, 80(5), 607–620. 10.1037/0021-9010.80.5.607
- Schulze, J., West, S. G., Freudenstein, J.-P., Schäpers, P., Mussel, P., Eid, M., & Krumm, S. (2021). Hidden framings and hidden asymmetries in the measurement of personality: A combined lens-model and frame-of-reference perspective. Journal of Personality, 89(2), 357–375. 10.1111/jopy.12586
- Semmer, N. K., Zapf, D., & Dunckel, H. (1995).
Assessing stress at work: A framework and an instrument . In O. Svane & C. Johansen (Eds.), Work and health: Scientific basis of progress in the working environment (pp. 105–113). Office for Official Publications of the European Communities. - Shaffer, J. A., & Postlethwaite, B. E. (2012). A matter of context: A meta-analytic investigation of the relative validity of contextualized and noncontextualized personality measures. Personnel Psychology, 65(3), 445–494. 10.1111/j.1744-6570.2012.01250.x
- Smither, J. W., Reilly, R. R., Millsap, R. E., Pearlman, K., & Stoffey, R. W. (1993). Applicant reactions to selection procedures. Personnel Psychology, 46(1), 49–76. 10.1111/j.1744-6570.1993.tb00867.x
- Sonnentag, S., Tay, L., & Nesher Shoshan, H. (2023). A review on health and well-being at work: More than stressors and strains. Personnel Psychology, 76(2), 473–510. 10.1111/peps.12572
- Tourangeau, R. (1987).
Attitude measurement: A cognitive perspective . In H.-J. Hippler, N. Schwarz, & S. Sudman (Eds.), Social information processing and survey methodology (pp. 149–162). Springer. 10.1007/978-1-4612-4798-2_8 - Wiechmann, D., & Ryan, A. M. (2003). Reactions to computerized testing in selection contexts. International Journal of Selection and Assessment, 11(2–3), 215–229. 10.1111/1468-2389.00245
- Wojujutari, A. K., Idemudia, E. S., & Ugwu, L. E. (2024). The evaluation of the General Health Questionnaire (GHQ-12) reliability generalization: A meta-analysis. PLoS ONE 19(7),
e0304182 . 10.1371/journal.pone.0304182
DOI: https://doi.org/10.16993/sjwop.348 | Journal eISSN: 2002-2867
Language: English
Page range: 13 - 13
Submitted on: Sep 18, 2024
Accepted on: Jul 1, 2025
Published on: Aug 29, 2025
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services
© 2025 Berit Greulich, Cornelius J. König, Carla V. Meixensberger, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.