Reliability scores for evaluation scales for DIALLS OER
| Material | Cronbach’s alpha |
|---|---|
| PD (for three materials packages) | 0.87 – 0.88 |
| Lesson Prompts | 0.86 |
| SPCLL | 0.94 |
Coding scheme and examples of coding categories
| Code | Example |
|---|---|
| Application | ‘I have found the lesson prompts easy to use’. |
| Content | ‘I found the PD material relevant and helpful across all the main areas covered. […]. The PD material was succinct and an appropriate length from my perspective. An excellent all-around introduction to this superb project’. |
| Design | ‘The lesson prompt was easy to follow’. |
| Value | ‘The teaching materials are very appealing to my students and are therefore an asset for classroom work’. |
| Adaptability | ‘I could then take them on and develop my lessons to cater for the needs of my own cohort and think about how I might want to expand the learning beyond discussion anticipated by the prompts’. |
| Reflection | ‘The Pedagogical Materials […] lead us to reflect on our daily practice of listening to others, regardless of their opinion and age, and may even lead me to change my way of working as I internalize their guidelines’. |
| Other | ‘I think the study is not good for preschoolers but more appropriate for older ages’. |
| Off-Topic (Units unrelated to the evaluation of the OER and DIALLS) | ‘Unfortunately, hardly anything was possible because of the corona restrictions’. |
Items for quantitative evaluation of the lesson plans
| Evaluation aspect | Item |
|---|---|
| Application 1 | I need additional support to be able to use the lesson prompts. |
| Application 2 | I can successfully apply what I’ve learned from the lesson prompts in the classroom (e.g., stimulate dialogue among students by asking questions). |
| Application 3 | I feel comfortable conducting a DIALLS lesson based on the lesson prompts. |
| Content 1 | The ideas on how to plan a DIALLS lesson mentioned in the lesson prompts are appropriate (e.g., the suggestions for dialogue are helpful for discussing the cultural issues from the films). |
| Content 2 | From looking at the lesson prompts, it is difficult for me to see which cultural themes are covered in the DIALLS lesson. |
| Content 3 | The lesson prompts make clear the goals of each respective DIALLS lesson. |
| Design 1 | The structure of the lesson prompts is confusing me. |
| Design 2 | The lesson prompts look appealing. |
| Design 3 | The design of the lesson prompts inspires me to engage in planning my DIALLS lessons. |
| Value 1 | The lesson prompts are valuable for my students (e.g., through the suggestions for discussion they have learned to engage in an interactive dialogue on cultural topics). |
| Value 2 | The lesson prompts are valuable for me from a professional perspective (e.g., I have a good foundation I can flexibly build on when planning my lessons). |
| Value 3 | I want to apply my experiences working with the lesson prompts to my future teaching. |
| Qualitative Feedback | Finally, is there anything else about the lesson prompts that you want to tell us? You can provide written feedback on how you experienced the lesson prompts in the text box below. |
Absolute and relative frequencies of coding categories
| Coding category | Absolute frequencies | Cumulative absolute frequencies | Relative frequencies | Cumulative relative frequencies |
|---|---|---|---|---|
| Application | 54 | 54 | 0.22 | 0.21 |
| Content | 26 | 80 | 0.10 | 0.31 |
| Design | 48 | 128 | 0.18 | 0.49 |
| Value | 41 | 169 | 0.16 | 0.65 |
| Adaptability | 26 | 195 | 0.10 | 0.75 |
| Reflection | 22 | 217 | 0.08 | 0.83 |
| Other | 19 | 236 | 0.07 | 0.90 |
| Off-Topic | 25 | 261 | 0.10 | 1.00 |
Descriptive statistics for DIALLS OER
| Material and subscale | n | Min | Max | M | SD |
|---|---|---|---|---|---|
| PD Total—Application | 2.11 | 5.00 | 3.96 | 0.06 | |
| PD Total—Content | 2.11 | 5.00 | 4.02 | 0.04 | |
| PD Total—Design | 2.00 | 5.00 | 4.20 | 0.06 | |
| PD Total—Value | 1.22 | 5.00 | 4.11 | 0.04 | |
| PD—Total | 121 | 2.47 | 5.00 | 4.07 | 0.50 |
| Lesson Prompts | |||||
| Application | 1.33 | 5.00 | 4.25 | 0.71 | |
| Content | 2.33 | 5.00 | 4.40 | 0.56 | |
| Design | 2.33 | 5.00 | 4.28 | 0.60 | |
| Value | 1.67 | 5.00 | 4.30 | 0.74 | |
| Lesson Prompts—Total | 77 | 2.83 | 5.00 | 4.31 | 0.53 |
| SPCLL | |||||
| Application | 1.67 | 5.00 | 3.94 | 0.70 | |
| Content—Cultural Learning Tool | 1.00 | 5.00 | 4.09 | 0.70 | |
| Content—Dialogue Progression Tool | 1.00 | 5.00 | 4.04 | 0.74 | |
| Design | 2.00 | 5.00 | 3.86 | 0.66 | |
| Value | 2.33 | 5.00 | 4.01 | 0.65 | |
| SPCLL—total | 65 | 1.80 | 5.00 | 3.99 | 0.60 |