
Figure 1
AI effectiveness framework.
Table 1
Score assigned to variables.
| DIMENSIONS (di) | SUBDIMENSIONS | VARIABLES (vn) | SCORE |
|---|---|---|---|
| Environment | • External | (v1) Universities | 2.5 |
| (v2) Exogenous solution | 2.5 | ||
| (v3) Inter-courts experience | 2.5 | ||
| (v4) Private companies | 2.5 | ||
| • Internal | (v5) Internal events | 2.0 | |
| (v6) Endogenous solution | 2.0 | ||
| (v7) Individual research | 2.0 | ||
| (v8) Innovation laboratories | 4.0 | ||
| d1 | 20.0 | ||
| Reliability | • Ethic | (v9) Future of work | 3.5 |
| (v10) Intellectual activities | 3.5 | ||
| • Transparency | (v11) Accountability | 6.0 | |
| • Data management | (v12) Problem definition | 3.5 | |
| (v13) Data accuracy | 3.5 | ||
| (v14) More automation than AI | 0 | ||
| d2 | 20.0 | ||
| Autonomy | • Responsibilities | (v15) Suggestions for legal acts | 10.0 |
| • Skills | (v16) Autonomous resolution | 10.0 | |
| d3 | 20.0 | ||
| Technics | • Tools | (v17) Initial thematic screening | 5.0 |
| (v18) Other AI applications | 5.0 | ||
| • Training | (v19) Training | 5.0 | |
| • Black box | (v20) Algorithm knowledge | 5.0 | |
| d4 | 20.0 | ||
| Results | • Efficiency | (v21) Measurement | 5.0 |
| • Efficacy | (v22) Strategic alignment | 5.0 | |
| • Impacts | (v23) Sharing | 10.0 | |
| d5 | 20.0 | ||
| 100.0 |
Table 2
The i – Eff valuation scale.
| NOTE | DESCRIPTION | CRITERION |
|---|---|---|
| A | Highly effectiveness | i – Eff ≥ 90% |
| B | Very effectiveness | 75% ≤ i – Eff < 90% |
| C | Medium effectiveness | 50% ≤ i – Eff < 75% |
| D | Lower effectiveness | 25% ≤ i – Eff < 50% |
| E | No effectiveness | i – Eff < 25% |

Figure 2
Word cloud of the textual corpus.

Figure 3
Correlation relationship of concepts.
Table 3
Environmental dimension data.
| SUB-DIMENSION | VARIABLES | COURTS | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ||
| • External | (v1) Universities | 2.5 | 0 | 0 | 0 | 0 | 0 | 2.5 | 0 | 0 | 2.5 | 0 | 0 | 0 | 0 | 0 | 0 |
| (v2) Exogenous solution | 0 | 2.5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| (v3) Inter-court experience | 0 | 0 | 0 | 2.5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2.5 | |
| (v4) Private companies | 0 | 2.5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| • Internal | (v5) Internal events | 0 | 0 | 0 | 2.0 | 0 | 2.0 | 0 | 0 | 0 | 0 | 0 | 0 | 2.0 | 0 | 0 | 0 |
| (v6) Endogenous solution | 2 | 0 | 2.0 | 0 | 0 | 0 | 0 | 0 | 2.0 | 0 | 2.0 | 0 | 0 | 2.0 | 0 | 2.0 | |
| (v7) Individual research | 2.0 | 0 | 0 | 0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 0 | 0 | 0 | 0 | 0 | 2.0 | 0 | |
| (v8) Innovation laboratories | 0 | 0 | 4.0 | 0 | 0 | 0 | 4.0 | 0 | 0 | 4.0 | 0 | 4.0 | 0 | 0 | 4.0 | 0 | |
| d1 | 6.5 | 5.0 | 6.0 | 4.5 | 2.0 | 4.0 | 8.5 | 2.0 | 4.0 | 6.5 | 2.0 | 4.0 | 2.0 | 2.0 | 6.0 | 4.5 | |
Table 4
Reliability dimension data.
| SUB-DIMENSION | VARIABLES | COURTS | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ||
| • Ethic | (v9) Future of work | 3.5 | 3.5 | 3.5 | 0 | 3.5 | 0 | 0 | 0 | 0 | 0 | 0 | 3.5 | 0 | 3.5 | 0 | 3.5 |
| (v10) Intellectual activities | 3.5 | 0 | 0 | 0 | 3.5 | 3.5 | 0 | 3.5 | 3.5 | 0 | 3.5 | 0 | 0 | 0 | 0 | 0 | |
| • Transparency | (v11) Accounta-bility | 6.0 | 0 | 6.0 | 6.0 | 6.0 | 6.0 | 6.0 | 0 | 6.0 | 0 | 6.0 | 6.0 | 0 | 0 | 6.0 | 6.0 |
| • Data management | (v12) Internal events | 0 | 3.5 | 0 | 0 | 0 | 0 | 0 | 0 | 3.5 | 3.5 | 3.5 | 0 | 3.5 | 3.5 | 0 | 3.5 |
| (v13) Endogenous solution | 3.5 | 0 | 0 | 3.5 | 3.5 | 0 | 3.5 | 0 | 3.5 | 3.5 | 0 | 0 | 0 | 3.5 | 0 | 0 | |
| (v14) More auto-mation than AI | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| d2 | 16.5 | 7.0 | 9.5 | 9.5 | 16.5 | 9.5 | 9.5 | 10.5 | 16.5 | 3.5 | 9.5 | 13.0 | 7.0 | 10.5 | 6.0 | 13.0 | |
Table 5
Autonomy dimension data.
| SUB-DIMENSION | VARIABLES | COURTS | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ||
| • Responsibilities | (v15) Suggestions for legal acts | 10.0 | 10.0 | 0 | 10.0 | 0 | 10.0 | 0 | 0 | 10.0 | 10.0 | 0 | 0 | 0 | 10.0 | 10.0 | 0 |
| • Skills | (v16) Autonomous resolution | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 10.0 | 0 | 0 | 10.0 | 0 | 0 | 10.0 | 0 |
| d3 | 10.0 | 10.0 | 0 | 10.0 | 0 | 10.0 | 0 | 0 | 20.0 | 10.0 | 0 | 10.0 | 0 | 10.0 | 20.0 | 0 | |
Table 6
Technical dimension data.
| SUB-DIMENSION | VARIABLES | COURTS | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ||
| • Tools | (v17) Initial thematic screening | 5.0 | 0 | 5.0 | 5.0 | 0 | 5.0 | 0 | 5.0 | 5.0 | 0 | 5.0 | 0 | 5.0 | 0 | 0 | 5.0 |
| (v18) Other AI applications | 0 | 5.0 | 0 | 0 | 5.0 | 0 | 5.0 | 0 | 0 | 5.0 | 0 | 5.0 | 0 | 5.0 | 5.0 | 0 | |
| • Training | (v19) Training | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 0 | 0 | 5.0 | 5.0 | 0 | 5.0 | 5.0 | 0 | 0 | 5.0 | 5.0 |
| • Black box | (v20) Algorithm knowledge | 5.0 | 5.0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5.0 | 0 | 0 | 0 | 0 | 0 |
| d4 | 15.0 | 15.0 | 10.0 | 10.0 | 10.0 | 5.0 | 5.0 | 10.0 | 10.0 | 5.0 | 15.0 | 10.0 | 5.0 | 5.0 | 10.0 | 10.0 | |
Table 7
Results dimension data.
| SUB-DIMENSION | VARIABLES | COURTS | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ||
| • Efficiency | (v21) Measurement | 0 | 5.0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5.0 | 5.0 | 0 | 0 | 0 |
| • Efficacy | (v22) Strategic alignment | 0 | 0 | 0 | 0 | 0 | 5.0 | 0 | 0 | 5.0 | 0 | 0 | 5.0 | 0 | 0 | 5.0 | 0 |
| • Impacts | (v23) Sharing | 10.0 | 10.0 | 0 | 10.0 | 10.0 | 0 | 0 | 0 | 0 | 10.0 | 10.0 | 0 | 0 | 0 | 0 | 10.0 |
| d5 | 10.0 | 15.0 | 0 | 10.0 | 10.0 | 5.0 | 0 | 0 | 5.0 | 10.0 | 10.0 | 10.0 | 5.0 | 0 | 5.0 | 10.0 | |
Table 8
Effectiveness index data.
| DIMENSION | COURTS | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | |
| Environment | 6.5 | 5.0 | 6.0 | 4.5 | 2.0 | 8.5 | 8.5 | 2.0 | 4.0 | 6.5 | 2.0 | 4.0 | 2.0 | 2.0 | 6.0 | 4.5 |
| Reliability | 16.5 | 7.0 | 9.5 | 9.5 | 16.5 | 9.5 | 9.5 | 10.5 | 16.5 | 3.5 | 9.5 | 13.0 | 7.0 | 10.5 | 6.0 | 13.0 |
| Autonomy | 10.0 | 10.0 | 0 | 10.0 | 0 | 10.0 | 0 | 0 | 20.0 | 10.0 | 0 | 10.0 | 0 | 10.0 | 20.0 | 0 |
| Technics | 15.0 | 15.0 | 10.0 | 10.0 | 10.0 | 5.0 | 5.0 | 10.0 | 10.0 | 5.0 | 15.0 | 10.0 | 5.0 | 5.0 | 10.0 | 10.0 |
| Results | 10.0 | 15.0 | 0 | 10.0 | 10.0 | 5.0 | 0 | 0 | 5.0 | 10.0 | 10.0 | 10.0 | 5.0 | 0 | 5.0 | 10.0 |
| Total | 58.0 | 52.0 | 25.5 | 44.0 | 38.5 | 33.5 | 23.0 | 22.5 | 55.5 | 35.0 | 36.5 | 47.0 | 19.0 | 27.5 | 47.0 | 37.5 |
| i – Eff | 58% | 52% | 26% | 44% | 39% | 34% | 23% | 23% | 56% | 35% | 37% | 47% | 19% | 28% | 47% | 38% |
| Grade | C | C | D | D | D | D | E | E | C | D | D | D | E | D | D | D |
