Figure 1
LbE Process
| RQ-1: | Following training on the LbE approach and use of software for conducting judgement, how and in what ways do secondary engineering teachers uniquely integrate Learning by Evaluating sessions into their curriculum? |
| RQ-2: | During participation in the Learning by Evaluating process, how and in what ways do comments made by students during the comparative judgement sessions to justify their decisions vary across different teachers? |
Table 1
Distribution of Student Participants
| TEACHER NUMBER | YEARS OF TEACHING EXPERIENCE | YEARS TEACHING THE FOTE COURSE | NUMBER OF STUDENT PARTICIPANTS |
|---|---|---|---|
| 1 | >10 | <5 | 17 |
| 2 | >20 | <5 | 10 |
| 3 | <5 | <5 | 23 |
| 4 | >10 | >5 | 10 |
| 5 | >20 | >5 | 38 |
Figure 2
LbE Judgement Interfaace
Figure 3
Prompt for Justification of Decision
Figure 4
LbE Prototyping Session Overview
Table 2
Alignment of LbE Session with Design Process
| TOPIC | TEACHER NUMBER | TOTAL | ||||
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | ||
| Course Orientation | 2 | 2 | ||||
| Define Problem | 1 | 1 | 2 | |||
| Brainstorm Possible Solutions | 2 | 1 | 2 | 2 | 7 | |
| Research Ideas/Explore Possibilities | 1 | 2 | 3 | |||
| Consider Alternative Solutions | 1 | 1 | 2 | 4 | ||
| Develop Written Design Proposal | 1 | 1 | ||||
| Test and Evaluate | 2 | 2 | ||||
| Create/Make Product | 1 | 1 | ||||
| Communicate Results | 1 | 2 | 2 | 1 | 6 | |
| Total Counts | 6 | 7 | 6 | 4 | 5 | 28 |
Table 3
Matrix of Claims Evidencing Reasoning Findings
| MAKING AND EXPLAINING KNOWLEDGE-DRIVEN DECISIONS | TEACHER NUMBER | TOTAL COUNTS | TOTAL (%) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | ||||||||
| # | % | # | % | # | % | # | % | # | % | |||
| Claim and Evidence | 31 | 30.4 | 104 | 48.4 | 4 | 100 | 156 | 26.7 | 61 | 57.5 | 356 | 35.2 |
| Only Claim | 64 | 62.7 | 68 | 31.6 | 0 | 0 | 295 | 50.4 | 26 | 24.5 | 453 | 44.8 |
| Neither Evidence nor Claim | 0 | 0.0 | 31 | 14.4 | 0.0 | 0.0 | 123 | 21.0 | 6 | 5.7 | 160 | 15.8 |
| Unclear | 7 | 6.9 | 12 | 5.6 | 0 | 0 | 11 | 1.9 | 13 | 12.3 | 43 | 4.2 |
| Total Counts | 102 | 215 | 4 | 585 | 106 | 1012 | ||||||