Figure 1.
Figure 2.
Figure 3.
j_ijanmc-2023-0071_tab_001
| Area | Mssion | State Collection | Action Semantic Set |
|---|---|---|---|
| Music playback | Register | {S0,S1,S2,S3,S4,S12 } | {select login, agree to the agreement, enter the username, enter the password, and click login} |
| Basin information | {S5,S6,S7,S8,S9} | {Recently played, locally downloaded personal cloud drive, friend list, favorite playlist} | |
| Discovering Music | {S10,S11,S12} | {Daily recommendation, click like, click play} | |
| Search Services | {S13,S14,S15,S16} | {Click to type, click to search, clear search, listen to music and recognize music} | |
| Persoral Settings | {S17,S18,S19,S20,S21,S22,S23} | {Message center, personal privacy, personalized services, advanced settings, about, log out, switch accounts} |
Distribution of defects discovered by various methods
| Error type | Defect type found | Semantic Modeling in Robot Vision Environment | Semantic modeling in a simulated environment | Humanoid | Stoat |
|---|---|---|---|---|---|
| Application crash defects | ActivityNotFoundException | 1 | 1 | 3 | 2 |
| lllegalArgumentException | 3 | 2 | 1 | 1 | |
| lllegalState Exception | 3 | 2 | 2 | 2 | |
| NullPointer Exception | 4 | 3 | 2 | 0 | |
| OutOfMemoryError | 2 | 2 | 1 | 2 | |
| amount | 13 | 10 | 9 | 7 |
Defect discovery results for each application
| APP | Semantic Modeling in Robot Vision Environment | Semantic modeling in a simulated environment | ||||
|---|---|---|---|---|---|---|
| Entity Coverage | Action Coverage | Task Coverage | Entity Coverage | Action Coverage | Task Coverage | |
| Apple Music | 84% | 82% | 87% | 84% | 82% | 89% |
| QQ Music | 83% | 89% | 85% | 86% | 89% | 83% |
| Music | 88% | 87% | 92% | 89% | 90% | 85% |
| TunePro Music | 93% | 92% | 93% | 93% | 92% | 93% |
| Shazam | 92% | 89% | 91% | 91% | 91% | 92% |
| Spotify | 90% | 90% | 93% | 92% | 89% | 91% |
| ES File Explorer | 89% | 87% | 87% | 89% | 86% | 89% |
| average | 89% | 89% | 81% | 88% | 90% | 89% |