Have a personal or library account? Click to login

Challenges and opportunities of using a cooperative digital educational plan. Evaluation of the implementation

Open Access
|Mar 2023

Figures & Tables

Figure 1

Technology Acceptance Model (Venkatesh & Davis, 2000, p. 188)
Technology Acceptance Model (Venkatesh & Davis, 2000, p. 188)

j_eurodl-2022-0006_tab_005

CategoryGuideline questions
ImageYou have told us about a rather positive/negative impression of the VSB at your school. How did you personally perceive the VSB?
To what extent do you comprehend (alternatively understand) or disagree with your colleagues’ opinions?
Subjective normHow would you describe the opinion of the VSB at your school?
What did you perceive?
VoluntarinessHow was the VSB introduced to your school? How do you feel about the decision regarding usage?
Mandatory or voluntary?
ExperienceHow would you describe your personal experiences using the VSB?
How often do you use the VSB?
Job relevanceCan you describe what the VSB is supposed to offer teachers?
Which tasks does the VSB undertake and which does it not undertake?
Output qualityWhich tasks in school does the VSB take on and which does it not undertake?
How well did the system work?
Further development suggestionsWhich other aspects are important to you?
Are there other issues on which you would like to report or focus?

Examples for Definition, Anchor Examples and Coding Rules for Job Relevance

SubcategoryDefinitionAnchor ExamplesCoding Rules
Task description of the VSBThe individual description of tasks the VSB undertakes‘A platform to present pupils with various special needs, to upload documents and more’ (GGS1–I3)Code all statements referring to which tasks the VSB is supposed to undertake in the interviewees understanding
Adjustment of own tasks and the VSBAll statements containing information about the adjustment of teachers’ tasks and the VSB‘Indeed I teach students, who are problematic and predestined for the platform or the platform is predestined for those students…’ (GGS1–I5)The interviewee speaks about the perceived adjustment of his/her own tasks and the supportive functions of the VSB

Main Results

Categories Coding ruleReductionFrequency
Subjective normAll statements that provide information about how the VSB is viewed at the schoolEnthusiastic, positive, positive in the first instance and thankful for its clarity6
Concerned, linked with negative emotions, shyness and frustration10
Additional barrier (especially in stressful times), an extra burden, additional work, a barrier, critical, negative, not sufficient and an overload16
Mostly veteran colleagues with little technical expertise struggle1

VoluntarinessThe interviewee describes the extent to which the usage decision was perceived as bindingUsing the VSB was perceived as voluntary9

Using the VSB was perceived as a commitment5
Using the VSB was perceived as mandatory9

ImageThe pedagogical specialist speaks about the influence of the VSB's image on her/his own opinionPositive attitude towards the VSB at first10

Decreasing positive attitude with increasing use results in confusion, frustration and little use3
Positive for its practicability, the overview and display of information, gaining time, companionship through SEN assessments and individual educational plan, interdisciplinary teamwork (e.g. with speech therapists), documentation and companionship for individual support especially in bigger school systems25
Despite current problematic issues teachers are confident about the future of the VSB. They verbalise a need for change and further training, vote for digitalisation and see opportunities11
Negative attitude towards the VSB. VSB as a barrier, time-consuming, additional workload, complicated, mysterious, non-self-explanatory and formulate concerns towards monitoring by their employers46

ExperienceCode all passages, providing information on how often the VSB was usedweekly, 3h/week, weekly to monthly for the documentation of discussions with parents, support of students, for research aims or as a support for SEN-assessment16
Continuous in the first 1–2 months, but decrease the use a short time after. They report rare use, often too rare to develop any sort of routine11
Teachers never used the VSB, only for a single instance, but never as a whole11

Experience - beneficial aspectsAll statements on the beneficial aspects of the overall conception of the VSBTeachers perceive the overview a beneficial11
Teachers liked the connection of diagnostic instruments and the options given for evaluation in a step-by-step education process8
Teachers liked the use of the VSB as a platform for an interactive exchange with their colleagues13
Experience - hindering aspectsAll statements on hindering aspects of the overall conception of the VSBTeachers experience hardware and technical problems. Missing scanner, notebooks and computer and no reliable connection hinder usage8
The identified hindering aspects such as technical obstacles lead to frustration, stress, disillusionment and require a great deal of time and additional workload26
Functionality (e.g. when uploading differing file formats), user-friendliness, complicated mapping, user interface, little intuitive handling, focus on competences, inflexibility, the evaluation of set goals, no option to sign documents, data protection57
Missing letters of agreement by student parents, technical problems at the introductory event, little collegial support, missing routine and workspaces, exchange with school administration and the distance to get help4

Job relevance - task descriptionAll statements are coded to describe the function of the VSB in school in general languageGive an overview and summary of teachers, pupils and their support, the evaluation of diagnostic instruments, provide guidance within the process of diagnostic instruments, enhance multi-professional teamwork, provide a platform to display information, offer an interface for multidisciplinary interaction (including professions outside the school systems), guide and support teachers, point out errors, administer data and facilitate SEN initiations, digitisation and the reachability of data as tasks53
Job relevance – adjustment of teachers’ tasks and VSB performanceAll statements are codes that describe the adjustment of teachers’ tasks and VSB performanceMatched teachers’ task when analysing diagnostic instruments for conscientious procedures when supporting students. Relevant for documentation, multi-professional teamwork, conscientious evaluation and creating small-step educational plans for students. Supportive and accompaniment when SEN initiatives were conducted21
Limited in matching teachers tasks. Speech disorders and competencies missing, difficulties with specific terms, missed opportunities for continuous documentation and struggled in collaborating with other schools when hiring diagnostic instruments. Documents provided were not sufficient for SEN assessments and took too much time13
Did not fit the teacher's tasks. Additional work and time with no clear usage. No assurance for privacy; not enough flexibility to work from home. Analogue work or other software and communication systems are preferred. Did not fit with the technical equipment of the school or their technical expertise26

Output qualityAll statements focussed on the specific fulfilment of tasks of the VSBEvaluation of diagnostic material, availability of diagnostic material, accompaniment and support, advancement of inclusion, possibility to document discussions with parents, continuous documentation, easing school change, output for digitisation and new types of educational plans, collection of data and the outcome for individual students and students with emotional and behavior disorder and learning difficulties18
Limited, because they are currently familiarising themselves, continuity is missing, technical hurdles limit its use, they face problems with the software, they spent a lot of time searching for buttons and use the VSB only as a shelf, agreements and collaboration continue to run analogously and analogue work is preferred11
No benefit because analogue work is rated as more effective, technical hurdles are too great, perceived as a burden/extra work/challenge/complicated, they have not used the hiring platform, there were no pupils matching or their educational plans differed Some teachers believe that future output is realistic30

Further development suggestionsCode all passages for further development suggestions for the VSBImproved design and user interface, print options, cloud functions for home office, extension of speech disabilities, library function, specific areas for educational plan, customisation, hints, links to other software, apps and tablets, tutorials, handbooks, dummy students, fixed VSB work times, extensive schoolwide use, step-by-step training of experts and later colleagues, training days56

Intercoder Reliability

Category SubcategoryTotal of coded passagesTotal: Coder ATotal: Coder BTotal: Common codings/Holsti-r
Overall1298642656615
Image2261091170.96
Subjective norm10250520.98
Voluntariness6733340.99
Experience – frequency12866620.91
Experience2911451460.98
Beneficial aspects8442420.98
Hindering aspects2071031040.98
Job relevance235118117
Task description10154470.81
Adjustment13464700.89
Output quality12562630.98
Further development suggestions12459651,00

Coding Guideline

Category SubcategoryVariableIndicatorGuideline question
Subjective norm (d)Perceived image of the VSBThe interviewee speaks about the perceived image of the VSB in his/her schoolHow do you/Please describe the opinions of the VSB in your school?
Image (d)Personal impact of the VSB's imageThe interviewee speaks about the influence of the image towards his/her own opinionYou have told us about a rather positive/negative opinion at your school. How did you personally perceive the VSB?
Voluntariness (d)Terms of useThe interviewee speaks about the perceived terms of useHow was the VSB implemented?Did it appear voluntary or mandatory to you?
Experience (d)Individual experience with the VSBThe interviewee speaks about their personal experience with the VSBHow do you describe your experience with the VSB?
How often do you use the VSB?
What was a hinderance/benefit for use?
Beneficial aspects (i)
Hindering aspects (i)
Job relevance (d)
Task description (i)Individual description of the tasks of the VSBThe interviewee described the tasks that the VSB should undertakeHow do you describe the tasks, that the VSB shall undertake?
Adjustment (i)Adjustment of how well the VSB matches teachers tasksThe interviewee describes the extent of adjustments between the VSB and his/her own tasksWhich tasks did the VSB actually undertake?
Output Quality (d)Perceived quality of the VSB for teachersThe interviewee describes the actual output of using the VSBWhich tasks did the VSB actually undertake?
Further development suggestions (i)Development suggestionsThe interviewee speaks about ideas to improve the VSBDo you have any further suggestions for the development of the VSB?
Language: English
Page range: 73 - 86
Published on: Mar 4, 2023
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 2 times per year

© 2023 Kathrina Walther, Silvia Fränkel, Thomas Hennemann, Dennis C. Hövel, published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 License.