Table 1.
Summary of the dataset based on two distribution categories.
| Distribution | Variables | Indicators | |||
|---|---|---|---|---|---|
| Min | Max | Average | Standard deviation | ||
| Normal | Session length | –2.41 | 69.26 | 30.06 | 9.96 |
| Clicks per minute | –2.84 | 12.06 | 4.98 | 2.02 | |
| Scroll depth percent | 7.49 | 100.00 | 74.18 | 18.14 | |
| Mouse distance Px | 0.70 | 3239.54 | 1017.62 | 482.40 | |
| Interface complexity | 1.00 | 10.00 | 5.02 | 1.95 | |
| Task completion time | 0.05 | 640.97 | 300.42 | 98.93 | |
| Age | 18.00 | 64.00 | 41.32 | 13.51 | |
| Lower bound | Upper bound | ||||
| Uniform | Keyboard activity level | 0 | 2 | ||
| Errors made | 0 | 10 | |||
| Help requested | 0 | 1 | |||
| Device type | 0 | 2 | |||
| Experience level | 0 | 2 | |||
| Gender | 0 | 2 | |||
| Satisfaction score | 1 | 5 | |||

Fig. 1.
Box-scatter plot for the dataset.
Table 2.
Obtained results of the fine-tuning values.
| Hyperparameters | Model | |||
|---|---|---|---|---|
| DTNO | DTFO | RFNO | RFFO | |
| N_estimators | – | – | 876 | 378 |
| Max_depth | 33 | 48 | 145 | 55 |
| Min_samples_split | 7 | 32 | 24 | 31 |
| Min_samples_leaf | 5 | 21 | 12 | 15 |
| Max_leaf_nodes | 11 | 3 | – | – |
Table 3.
Performance of the developed models in the training and testing phases.
| Model | Index values | ||||
|---|---|---|---|---|---|
| Accuracy | Precision | Recall | F1-score | ||
| Train | DTC | 0.952 | 0.952 | 0.952 | 0.952 |
| DTNO | 0.969 | 0.969 | 0.969 | 0.969 | |
| DTFO | 0.982 | 0.982 | 0.982 | 0.982 | |
| RFC | 0.960 | 0.960 | 0.960 | 0.960 | |
| RFNO | 0.980 | 0.980 | 0.980 | 0.979 | |
| RFFO | 0.992 | 0.992 | 0.992 | 0.992 | |
| Test | DTC | 0.933 | 0.934 | 0.933 | 0.933 |
| DTNO | 0.936 | 0.936 | 0.936 | 0.936 | |
| DTFO | 0.974 | 0.974 | 0.974 | 0.974 | |
| RFC | 0.937 | 0.937 | 0.937 | 0.937 | |
| RFNO | 0.940 | 0.940 | 0.940 | 0.940 | |
| RFFO | 0.984 | 0.984 | 0.984 | 0.984 | |
Table 4.
Comparison between the models in five classes.
| DT models | RF models | |||||
|---|---|---|---|---|---|---|
| DTC | RFC | |||||
| Class | Precision | Recall | F1-score | Precision | Recall | F1-score |
| 1 | 0.95 | 0.95 | 0.95 | 0.96 | 0.95 | 0.96 |
| 2 | 0.95 | 0.95 | 0.95 | 0.96 | 0.96 | 0.96 |
| 3 | 0.95 | 0.95 | 0.95 | 0.95 | 0.96 | 0.95 |
| 4 | 0.96 | 0.94 | 0.95 | 0.96 | 0.96 | 0.96 |
| 5 | 0.94 | 0.95 | 0.95 | 0.95 | 0.96 | 0.95 |
| DTNO | RFNO | |||||
| Precision | Recall | F1-score | Precision | Recall | F1-score | |
| 1 | 0.97 | 0.96 | 0.96 | 0.97 | 0.97 | 0.97 |
| 2 | 0.97 | 0.96 | 0.97 | 0.97 | 0.97 | 0.97 |
| 3 | 0.95 | 0.96 | 0.95 | 0.98 | 0.98 | 0.98 |
| 4 | 0.96 | 0.96 | 0.96 | 0.97 | 0.96 | 0.97 |
| 5 | 0.96 | 0.97 | 0.97 | 0.98 | 0.97 | 0.98 |
| DTFO | RFFO | |||||
| Precision | Recall | F1-score | Precision | Recall | F1-score | |
| 1 | 0.98 | 0.98 | 0.98 | 0.99 | 0.99 | 0.99 |
| 2 | 0.98 | 0.98 | 0.98 | 0.99 | 0.99 | 0.99 |
| 3 | 0.98 | 0.98 | 0.98 | 0.99 | 1.00 | 0.99 |
| 4 | 0.98 | 0.98 | 0.98 | 0.99 | 0.99 | 0.99 |
| 5 | 0.98 | 0.98 | 0.98 | 0.99 | 0.99 | 0.99 |

Fig. 2.
Confusion matrix for the accuracy of the developed models.

Fig. 3.
Comparison of TPR versus FPR for the studied models.

Fig. 4.
Sensitivity analysis of input variables using the CAM, showing that mouse distance, clicks per minute, and interface complexity are the three most influential factors affecting model performance.