Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

Figure 6.

Figure 7.

Figure 8.

Figure 9.

Figure 10.

Figure 11.

Figure 12.

Figure 13.

Figure 14.

OPTIMIZER PARAMETER SETTING
| Optimizer | parameter |
|---|---|
| SGD | lr=0.001, |
| Adam | lr=0.001, |
| Adamax | lr=0.002, |
| RMSprop | lr=0.001, |
AUGMENTATION RESULT
| Subset category | Number of samples |
|---|---|
| Training set | 73257 |
| Extra set | 531131 |
| Test set | 26032 |
OPTIMIZERS TRAINING RESULTS
| optimizer | Top Accuracy/% |
|---|---|
| SGD | 87.350184 |
| Adam | 89.090000 |
| Adamax | 88.955900 |
| RMSprop | 88.676000 |
RESULT AFTER DATA AUGMENTATION
| Train sample number | test sample number | Best test accuracy | time |
|---|---|---|---|
| 73257 | 26032 | 90.01229 | 1h24min |
| 604388 | 26032 | 92.32483 | 6h17min |
RESULT OF DIFFERENT WEIGHT DECAY
| weight_decay | Train Acc%(e) | Test Acc%(e) |
|---|---|---|
| 0.01 | 89.01538(85) | 87.14659(85) |
| 0.005 | 91.59397(57) | 88.95590(57) |
| 0.0025 | 94.51470(88) | 90.01229(88) |
| 0.001 | 97.21119(90) | 89.70498(24) |