Have a personal or library account? Click to login
Measuring Work Demands and Resources of Digitalisation: The ICT Resources and Stressors Scale Cover

Measuring Work Demands and Resources of Digitalisation: The ICT Resources and Stressors Scale

Open Access
|Jul 2024

Figures & Tables

Table 1

Validation procedure and steps of analysis.

STEPRESEARCH QUESTIONTYPE OF ANALYSIS/PROCEDUREDESCRIPTIONLEVEL OF ANALYSIS
I1IdentificationIdentification of relevant constructs and scalesConstructs, scales
II2Content validityRevision of definitions and adaptation of items. Preliminary study with subject experts.Constructs, scales, items
III3Item analysisAnalysis of response frequencies, variances, item difficulty, item discrepancy indices, and reliabilities.Single items, scales
First exclusion after step III
IV3Analysis of measurement modelsVerification of model goodness-of-fit, average variances extracted (AVE) and loadings of indicators using confirmatory factor analysis.Single items, scales
Second exclusion after step IV
V3Known-group
comparison
Verification if scales can measure mean differences in known groups and show measurement invariance.Entire questionnaire
VI3Analysis of criterion validityVerification of predictive power of ICT resources and stressors regarding health and work attitudes.Single scales
VII3Analysis of interaction effectsExamination of moderation effects by ICT resources on the relationship between ICT stressors and health, or work attitudes.Single scales
VIII3Impact of control variablesVerification if relationships between variables were preserved when relevant control variables were taken into account.Single scales
IX3Incremental validityVerification if ICT resources and stressors could explain additional variance above more general resources and demands.Entire questionnaire
Third exclusion after step IX
Table 2

Identified constructs.

CONSTRUCT(NR. OF ITEMS)DESCRIPTIONORIGIN OF ITEMS
Techno-complexity (4)Techno-complexity occurs when users experience their own skills as insufficient due to the complexity of ICTs and they are required to invest time and effort in learning and understanding them (Tarafdar et al., 2007)Technostress creators (Ragu-Nathan etal., 2008)
Techno-uncertainty (4)Techno-uncertainty arises when ICTs change constantly. As a result, users feel forced to keep up to date and learn new technologies (Tarafdar et al., 2007).Technostress creators (Ragu-Nathan et al., 2008)
Literacy facilitation (4)Organisations can reduce stress from ICTs by promoting the sharing of ICT knowledge within the organisation. It reduces stress by helping users understand ICTs and their impact, and by enabling them to cope with the demands of learning new ICTs (Ragu-Nathan et al., 2008).Technostress inhibitors (Ragu-Nathanet al., 2008)
Involvement facilitation (3)By involving employees in the process of technological change, i.e. by informing users about the reasons and expected effects of new technologies as well as motivating them to use new ICTs, organisations can reduce the negative impacts of the implementation process (Ragu-Nathanet al., 2008).Technostress inhibitors (Ragu-Nathan et al., 2008)
Usefulness (4)An ICT is useful when it improves work performance. Technologies that are considered useful reduce feelings of workload, leading to employees accomplishing work tasks faster and being more productive (Ayyagari et al., 2011).Antecedents of technostress (Ayyagari etal., 2011)
Poor communication (3)ICT-mediated communication offers great potential for errors because very few verbal or non-verbal signals are present (Rainey, 2000). Poor communication skills can lead to frustration and higher levels of strain in employees (Dayet al., 2010).ICT demands (Day et al., 2012)
Employee monitoring (4)Monitoring employees’ work performance, communication (emails or phone calls) or internet use during work using ICTs, may be perceived as an invasion of privacy. This can lead to higher feelings of stress, anxiety, depression, health complaints, anger, and exhaustion (Amick & Smith, 1992; Day et al., 2012; Lund, 1992; Schleifer & Shell, 1992).ICT demands (Day et al., 2012)
Lack of control (3)Lack of control describes the degree of influence employees have over the ICTs they use. Individuals with less control over ICTs are more anxious, and experience more frustration and more stress (Day et al., 2010; Day etal., 2012; Hair et al., 2007; O’Driscoll et al., 2010).ICT demands (Day et al., 2012)
ICT resources & upgrades (4)ICT resources & upgrades means providing current technology, necessary updates and training in the introduction of new ICTs. This can increase employees’ self-efficacy and confidence in using new ICTs, which in turn can reduce stress (Beas & Salanova, 2006; Dayet al., 2012).ICT resources (Day et al., 2012)
Personal assistance (4)Personal assistance reduces stress following operational problems with ICTs and can be provided by an organisation in the form of an IT support department. Technical IT support can increase employee engagement with ICTs (O’Driscoll et al., 2010). Competent support further leads to faster resolution of problems, which in turn results in fewer work interruptions (Ragu-Nathan etal., 2008) and thus has a positive impact on stress levels.ICT resources (Day et al., 2012)
Telepressure (6)Workplace telepressure manifests itself by constantly thinking about a received ICT-based message, accompanied by the urge to respond immediately (Barber& Santuzzi, 2015). Telepressure is associated with workaholism, absenteeism, poorer sleep quality, work overload, emotional exhaustion, less detachment from work, and lower satisfaction with one’s work-life balance (Barber & Santuzzi, 2015; Barber et al., 2019; Grawitch et al., 2018; Santuzzi& Barber, 2018).Telepressure (Barber & Santuzzi, 2015)
Table 3

Revised items of the new questionnaire.

CONSTRUCTITEM CODEITEMS
Techno-complexityTechCom_rag1I do not know enough about the ICTs I use, to handle my job satisfactorily.
TechCom_rag2I can easily understand and use new ICTs. a
TechCom_rag3I do not find enough time to improve my ICT skills.
TechCom_rag4I often find new ICTs too complex for me to understand and use.
Techno-uncertaintyTechUnc_rag1There are always new developments in the ICTs we use in our organisation.
TechUnc_rag2There are constant changes in computer software in our organisation.
TechUnc_rag3There are constant changes in computer hardware in our organisation.
TechUnc_new1I feel insecure due to the constant changes in ICTs in our organisation.
TechUnc_new2I wished the ICTs in our organisation were not constantly changing.
TechUnc_new3I am overwhelmed by having to learn new ICTs all the time.
Literacy facilitationLiteFac_rag1Our organisation emphasises teamwork in dealing with new ICT-related issues.
LiteFac_rag2Our organisation provides end-user training before the introduction of new ICTs.
LiteFac_rag3Our organisation fosters a good relationship between the IT department and end users.
LiteFac_rag4Our organisation provides clear documentation to end users on using new ICTs.
Involvement facilitationInvoFac_rag1We as end users are consulted before introducing new ICTs.
InvoFac_rag2We as end users are involved in the technological change and implementation of ICTs.
InvoFac_New1Our organisation communicates in a transparent way about the reasons for introducing new ICTs.
InvoFac_New2Our organisation communicates in a transparent way about the hoped-for effects of the introduction of new ICTs.
UsefulnessUsefuln_ayy1The ICTs I use at work enable me to accomplish my tasks more quickly.
Usefuln_ayy2The ICTs I use at work improve the quality of my work.
Usefuln_ayy3The ICTs I use at work make it harder for me to do my job. a
Usefuln_ayy4The ICTs I use at work enhance my effectiveness.
Poor communicationPoorCom_day1People often misinterpret my ICT-based text messages.
PoorCom_day2I often receive rude ICT based text messages from my colleagues or clients.
PoorCom_day3I often misinterpret the tone of incoming ICT-based text messages.
MonitoringEmpMoni_day1My organisation uses ICTs to monitor my work.
EmpMoni_day2My organisation monitors my internet usage.
EmpMoni_day3My organisation monitors my emails.
EmpMoni_day4My organisation monitors my phone calls.
EmpMoni_new1I experience the monitoring of my work as an invasion of my privacy.
EmpMoni_new2I do not mind my organisation monitoring my work activities.
EmpMoni_new3I do not want my organisation monitoring my work activities.
ICT ControlControl_day1I have no control over how I use ICTs at work. a
Control_day2I choose the types of ICTs I use in my work myself.
Control_day3ICTs allow me the flexibility to do my work when I want.
Control_day4ICTs allow me the flexibility to do my work where I want.
Personal assistancePersAs_day1Technical support is available at work when I need it.
PersAs_day2Our technical support staff are helpful.
PersAs_day3My organisation’s technical support staff respond promptly to all my requests.
PersAs_day4Our technical support teaches me how to solve problems in case they happen again.
ICT resources & upgradesICTResU_day1My organisation implements appropriate software as it becomes available.
ICTResU_day2My organisation uses the latest technology.
ICTResU_day3I receive the upgrades I need.
ICTResU_day4New ICT systems in my organisation are implemented on a timely basis.
TelepressureTelepr_barsan1It’s hard for me to focus on other things when I receive a message from someone.
Telepr_barsan2I can concentrate better on other tasks once I’ve responded to my messages.
Telepr_barsan3I can’t stop thinking about a message until I’ve responded.
Telepr_barsan4I feel a strong need to respond to others immediately.
Telepr_barsan5I have an overwhelming feeling to respond right at that moment when I receive a request from someone.
Telepr_barsan6It’s difficult for me to resist responding to a message right away.

[i] Note. aReverse coded after feedback in a preliminary study.

spo-4-1-59-g1.png
Figure 1

Overview of sample characteristics.

Note. To enhance readability, plot 1 shows the ten most reported work areas (n = 308). One respondent did not provide information on education or years of employment (n = 355). The total number of respondents for importance of ICTs is 356. The work areas were derived from the general classification of economic activities, and the education levels from the educational degrees and certificates by the Federal Statistical Office (FSO, 2008, 2020).

Table 4

Descriptive item statistics.

ITEMMSDMEDMINMAXITEM DIFFI- CULTYDISCRIMI- NATION INDEXα WHEN DELETEDSKEWKURTOSIS
TechCom_rag11.870.98215.37.61.67  1.10  0.62
TechCom_rag22.190.87215.44.46.75  0.93  0.98
TechCom_rag32.741.09315.55.54.72  0.08–0.92
TechCom_rag42.040.90215.41.64.66  0.84  0.35
TechUnc_rag12.911.03315.58.71.72  0.06–0.68
TechUnc_rag22.821.10315.56.68.75  0.19–0.84
TechUnc_rag32.331.00215.47.64.79  0.58–0.23
TechUnc_new11.730.87215.35.73.79  1.24  1.19
TechUnc_new22.081.13215.42.73.79  0.86–0.24
TechUnc_new31.740.97115.35.72.79  1.28  0.98
LiteFac_rag13.181.09315.64.58.74–0.33–0.59
LiteFac_rag23.021.23315.60.60.73–0.12–0.94
LiteFac_rag33.211.17315.64.61.73–0.28–0.78
LiteFac_rag43.161.20315.63.58.74–0.29–0.82
InvoFac_rag12.861.23315.57.68.81  0.03–1.08
InvoFac_rag22.881.11315.58.62.83–0.05–0.86
InvoFac_New13.291.19415.66.73.78–0.43–0.73
InvoFac_New23.301.11315.66.70.80–0.37–0.65
PoorCom_day11.730.75215.35.54.55  0.92  0.86
PoorCom_day21.440.76115.29.43.68  2.01  4.45
PoorCom_day31.840.82215.37.54.54  0.79  0.25
EmpMoni_day11.800.90214.45.60.84  0.72–0.64
EmpMoni_day21.740.95114.43.74.78  1.08  0.05
EmpMoni_day31.570.84114.39.76.77  1.42  1.15
EmpMoni_day41.410.73114.35.64.82  1.86  2.94
EmpMoni_new11.981.07214.50.41.76  0.64–0.94
EmpMoni_new22.791.02314.70.59.55–0.23–1.18
EmpMoni_new32.801.06314.70.60.53–0.37–1.11
Control_day13.451.18415.69.29.77–0.31–0.91
Control_day22.581.23215.52.48.68  0.33–0.92
Control_day33.211.41315.64.68.55–0.27–1.24
Control_day43.431.46415.69.62.59–0.47–1.17
PersAs_day13.771.06415.75.67.79–0.72–0.08
PersAs_day24.030.98415.81.73.77–0.96  0.64
PersAs_day33.631.07415.73.73.77–0.56–0.37
PersAs_day43.241.14315.65.56.84–0.25–0.74
ICTResU_day13.121.13315.62.75.83–0.14–0.78
ICTResU_day23.081.15315.62.74.83–0.10–0.92
ICTResU_day33.701.04415.74.65.86–0.62–0.15
ICTResU_day43.161.06315.63.77.82–0.12–0.71
Telepr_barsan12.631.20215.53.73.88  0.31–0.92
Telepr_barsan23.311.203.515.66.69.89–0.36–0.81
Telepr_barsan32.391.10215.48.73.88  0.42–0.64
Telepr_barsan43.021.24315.60.72.88–0.19–1.07
Telepr_barsan52.551.27215.51.70.89  0.27–1.14
Telepr_barsan62.781.22315.56.81.87  0.20–0.99
Usefuln_ayy13.940.98415.79.71.69–0.94  0.59
Usefuln_ayy23.750.95415.75.64.73–0.72  0.37
Usefuln_ayy34.180.89415.84.35.86–1.24  1.72
Usefuln_ayy43.900.95415.78.76.67–0.85  0.61

[i] Note. n = 356. Item difficulties and reliabilities without item (α when deleted) refer to the corresponding scale, not to the entire questionnaire.

Table 5

Fit indices of measurement models.

SCALEχ2RMSEACFITLISRMRAICBICAVE
Literacy facilitation  7.903 (df = 2; p < .05)  .107 [.037, .189]  .979  .937  .0294’1264’157.48
Involvement facilitation  29.521 (df = 2; p < .001)  .219 [.153, .292]  .945  .835  .0523’8793’910.58
ICT control.59
Personal assistance.54
ICT resources & upgrades.68
Telepressure  41.326 (df = 9; p < .001)  .113 [.079, .149]  .966  .944  .0355’7035’750.60
Overall model  340.136 (df = 215; p < .001)  .040 [.033, .048]  .965  .959  .03822’23622’472.58
Alternative A  1178.783 (df = 229; p < .001)  .0.114 [.108, .121]  .730  .702  .08423’14723’329.40
Alternative B  857.084 (df = 227; p < .001)  .093 [.087, .100]  .821  .800  .06622’79122’981.47

[i] Note. n = 356. ICT control, personal assistance and ICT resources & upgrades had each three indicators and were exactly identified. Therefore, no fit indices could be estimated for these models.

Table 6

Squared loadings of individual items.

ITEMSλ2,aITEMSλ2,a
LiteFac_rag3.51PersAs_day1.60
LiteFac_rag2.49PersAs_day4.41
LiteFac_rag1.46ICTResU_day1.69
LiteFac_rag4.46ICTResU_day4.68
InvoFac_New1.74ICTResU_day2.67
InvoFac_New2.68Telepr_barsan6.75
InvoFac_rag1.49Telepr_barsan1.61
InvoFac_rag2.41Telepr_barsan3.60
Control_day3.92Telepr_barsan4.59
Control_day4.65Telepr_barsan5.55
Control_day2.20Telepr_barsan2.53
PersAs_day3.61

[i] Note. n = 356.

aλ2 = squared loadings.

Table 7

Bivariate correlations of the latent variables in the overall model.

VARIABLES12345
1Literacy facilitation
2Involvement facilitation.76***
3ICT control.30***.21***
4Personal assistance.75***.48***.30***
5ICT resources & upgrades.60***.55***.27***.46***
6Telepressure.08.07.16**.03.09

[i] Note. n = 356.

ƚ p < .10, * p < .05, ** p < .01, *** p < .001.

Table 8

Fit indices of the different measurement invariance models regarding ICT importance.

MODELχ2RMSEACFITLISRMRAICBIC
Configural MIa375.151 (df = 284; p < .001).052 [.036, .065].959.951.05613’85714’336
Metric MI389.889 (df = 298; p < .001).050 [.035, .064].959.953.05813’84114’271
Scalar MI423.799 (df = 312; p < .001).054 [.040, .066].951.947.06013’84314’223
Same means479.218 (df = 317; p < .001).064 [.052, .075].930.925.09113’88314’245
Differenceb55.419 (df = 5, p < .847).01–.021–.022.0314022

[i] Note. n1 = 87, n2 = 178.

aMI = Measurement invariance.

bDifference between the same means model and model of scalar invariance.

spo-4-1-59-g2.png
Figure 2

Prediction of health outcomes and attitudes towards work.

Note. Only significant paths are shown.

ƚ p < .10, * p < .05, ** p < .01, *** p < .001.

Table 9

Bivariate correlations between predictors and outcome variables.

VARIABLES12345678910
1InvoFac
2Control  .18**
3ICTResU  .56***  .25***
4PersAs  .48***  .27***  .47***
5Telepre  .05  .16*  .08  .02
6JobSat  .38***  .23**  .36***  .35***–.05
7IntQuit–.30***–.30***–.22**–.28***–.03–.77***
8AffComm  .36***  .35***  .28***  .33***  .10ƚ  .81***–.88***
9Exhaustion–.32***–.17*–.26***–.22**  .26***–.49***  .31***–.27***
10Wellbeing  .19**  .15*  .15*  .17*–.15*  .50***–.36***  .40***–.64***
11GenHealth–.01  .01  .14*  .09–.12*  .17*–.11ƚ  .11ƚ–.40***.47***

[i] Note. ƚ p < .10, * p < .05, ** p < .01, *** p < .001.

spo-4-1-59-g3.png
Figure 3

Relationship between telepressure and job satisfaction at different levels of ICT control.

Note. Job satisfaction at different levels of ICT control: one standard deviation below the mean (solid line), at the mean (dotted line) and one standard deviation above the mean (dashed line).

Table 10

Comparison of regression weights between models with and without control variables.

VARIABLESJOB SATISFACTIONINTENTION TO QUITAFFECTIVE COMMITMENT
MODEL AMODEL BMODEL AMODEL BMODEL AMODEL B
βpβpβpβpβpβp
InvoFac  .21  .031*  .20.036*–.20  .017*–.18.022*  .24  .004**  .21.007**
Control  .13  .072ƚ  .12.114–.23  .001**–.18.013*  .26  .000***  .19.006**
ICTResU  .16  .062ƚ  .18.031*  .01  .914–.05.547  .02  .819  .09.265
PersAs  .15  .097ƚ  .12.159–.12  .152–.08.350  .14  .092ƚ  .09.232
Telepre–.09  .141–.08.212  .02  .763  .00.990  .04  .452  .06.292
Age  .11.057ƚ–.26.000***  .28.000***
DigOpen–.05.500  .00.997  .06.373
EXHAUSTIONWELL–BEINGGENERAL HEALTH
MODEL AMODEL BMODEL AMODEL BMODEL AMODEL B
βpβpβpβpβpβp
InvoFac–.25  .003**–.22.008**  .13  .141  .10.237–.15  .067ƚ–.15.06ƚ
Control–.14  .034*–.11.116  .13  .049*  .06.422–.02  .806  .00.960
ICTResU–.10  .219–.09.291  .04  .670  .06.475  .20  .016*  .19.028*
PersAs–.02  .862–.04.634  .06  .490  .06.520  .07  .383  .09.281
Telepre  .30  .000***  .33.000***–.18  .002**–.19.001**–.13  .033*–.15.022*
Age  .11.084ƚ  .10.114–.11.072ƚ
DigOpen–.18.009**  .17.017*  .03.664

[i] Note. n = 324 (one missing indication of age). Model A = original structural model, model B = with control variables.

ƚ p < .10, * p < .05, ** p < .01, *** p < .001.

Table 11

Bivariate correlations of ICT resources and stressors, outcome variables, and general resources and stressors.

VARIABLES123456789101112131415161718
1InvoFac
2ICTControl  .19**
3ICTResU  .56***  .26***
4PersAs  .48***  .28***  .47***
5Telepre  .05  .16*  .08  .02
6JobSat  .38***  .23**  .37***  .35***–.05
7IntQuit–.29***–.3***–.22**–.28***–.03–.76***
8AffComm  .36***  .36***  .28***  .33***  .10ƚ  .81***–.87***
9Exhaustion–.32***–.17*–.26***–.21**  .26***–.49***  .31**–.27**
10Wellbeing  .20**  .16*  .15*  .18*–.15*  .50***–.36***  .40***–.64***
11GenHealth–.01  .01  .14*  .09–.13*  .16*–.10  .1ƚ–.40***  .48***
12Age  .03  .19**–.07  .14*–.05  .14*–.31***  .34***  .03  .16*–.10ƚ
13DigOpen  .16*  .36***  .11  .08  .14*  .06–.15*  .23**–.20**  .20**–.01  .16*
14JobCtrl  .20**  .68***  .18**  .27***  .10  .31***–.37***  .38***–.25***  .16*  .12*  .28***  .20**
15TaskComp  .09  .15*  .09  .08–.08  .3***–.22**  .24***–.11ƚ  .22***  .05  .12*  .01  .2**
16Particip  .41***  .32***  .16**  .24***–.05  .47***–.44***  .47***–.24***  .20**  .09  .15**  .14ƚ  .43***  .21***
17QualOverl–.10  .09  .02–.05  .17*–.03–.09  .07  .42***–.26***–.11ƚ–.16*–.07  .07–.07–.05
18SocStres–.27**–.31***–.25**–.26**  .10–.62***  .52***–.53***  .47***–.37***–.15ƚ–.16**–.11–.38***–.25**–.40***.15ƚ
19POWT–.46***–.21**–.56***–.48***  .03–.49***  .34***–.33***  .48***–.37***–.28***–.04–.17*–.23**–.20**–.37***.29**.40***

[i] Note. n = 324 (one missing indication of age).

ƚ p < .10, * p < .05, ** p < .01, *** p < .001.

Table 12

Difference in explained variance in outcome variables.

VARIABLESORIGINAL MODELINCL. ICT RESOURCES AND STRESSORSONLY TELEPRESSUREONLY ICT RESOURCES
R2R2Δ R2Δ in %R2Δ R2Δ in %R2Δ R2Δ in %
GenHealth.117.164.04740.5%.130.01411.6%.154.03732.0%
Exhaustion.461.517.05612.1%.506.0459.7%.469.0071.6%
AffComm.472.505.0347.2%.487.0153.3%.493.0224.6%
Wellbeing.254.265.0114.3%.264.0104.1%.254.0000.0%
JobSat.515.531.0163.1%.516.0010.2%.531.0163.0%
IntQuit.441.452.0102.4%.444.0030.8%.449.0081.8%

[i] Note. The original model contained the outcome variables general health, exhaustion, affective commitment, well-being, job satisfaction, intention to quit, the control variables age, attitude towards digital change and the predictors job control, completeness of work tasks, participation, qualitative overload, social stressors and problems with the organisation of work tasks.

Table 13

Overview of results for the final questionnaire.

SCALERELIABILITYCONSTRUCT VALIDITYCRITERION VALIDITY
MEASUREMENT MODELSMEASUREMENT INVARIANCEMEAN DIFFERENCES IN ICT IMPORTANCEPREDICTION OF HEALTH OUTCOMESPREDICTION OF WORK ATTITUDESMODERATIONROBUSTNESS (CONTROL VARIABLES)INCREMENTAL VALIDITY
Involvement facilitationα = .85, ω = .85acceptableyesnoin partyesnoyesyes
ICT controlα = .77, ω = .82acceptableyesnoin partyesfor Job satisfactionin partyes
ICT resources & upgradesα = .86, ω = .86acceptableyesnoin partnonoyesyes
Telepressureα = .90, ω = .90acceptableyesnoyesno-yesyes

[i] Note. Measurement invariance, mean differences in ICT importance and incremental validity were analysed regarding the entire questionnaire, not individual scales.

DOI: https://doi.org/10.5334/spo.59 | Journal eISSN: 2752-5341
Language: English
Submitted on: Jun 27, 2023
|
Accepted on: Jun 18, 2024
|
Published on: Jul 1, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Jari Cianci, David Weibel, Achim Elfering, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.