
Figure 1:
Diagram for the proposed method.

Figure 2:
Flow diagram for video swim feature pyramid video encoder. FPN, feature pyramid network.

Figure 3:
Flowchart for final summation output in multimodal systems.

Figure 4:
Heat map of the proposed model.

Figure 5:
Model loss of the proposed model.

Figure 6:
Accuracy of the proposed model.

Figure 7:
Recall of the proposed model.

Figure 8:
Precision of the proposed model.

Figure 9:
F1 score of the proposed model.

Figure 10:
Feature values representation of DTW. DTW, dynamic time warping.

Figure 11:
Feature values representation of FPN. FPN, feature pyramid network.

Figure 12:
Recall score (@1, @5, @10) for the proposed model.

Figure 13:
(A, B, C): Recall comparison of the proposed model with the existing models with (R@1, R@5, and R@10).

Figure 14:
MdR comparison of the proposed model. MdR, median rank.

Figure 15:
MnR comparison of the proposed model. MnR, mean rank.

Figure 16:
RMSE comparison for the proposed model. RMSE, root mean square error.

Figure 17:
MAE comparison of the proposed model. MAE, mean absolute error.