Aircraft Pilot Assistance System: Detection of Other Aircraft Using Artificial Neural Networks

Tomiło, Paweł

doi:10.2478/ttj-2025-0009

Abstract

The publication presents a pilot assistance system that is based on video camera frames and uses the developed 3AFPBBYOLO artificial neural network model. The model is able to determine the relative location of other aircraft in the vicinity of an aircraft equipped with this system. Current solutions, the model development process, training, validation, and testing are presented. In the development process, different types of solutions as well as sizes of detection models were tested. In addition, the model inference time with the use of a single-chip mini-computer was examined. The developed model has better values of metrics compared to other solutions. A number of tests were conducted both using a ground station and actual use of the system in flight. The tests conducted using the ground station and the auxiliary hyper-inference algorithm showed that the effective distance from which the model is able to detect an aircraft is 705.09 m. At a fixed distance, the model’s effectiveness is 90.14%. In the flight test using the auxiliary tracking algorithm, the model’s effectiveness was 100%. The developed model is capable of real-time inference.

References

Aharon, N., Orfaig, R., Bobrovsky, B.-Z. (2022) BoT-SORT: Robust associations multi-pedestrian tracking. ArXiv, abs/2206.14651.
Search in Google Scholar Back to article
Akyon, F.C., Altinuc, S.O., Temizel, A. (2022) Slicing aided hyper inference and fine-tuning for small object detection. In: Proceedings of IEEE International Conference on Image Processing (ICIP), Bordeaux, October 2022. IEEE, pp. 966-970. https://doi.org/10.1109/ICIP46576.2022.9897990.
Search in Google Scholar Back to article
Džunda, M., Dzurovčin, P., Melníková, L. (2022) Anti-collision system for small civil aircraft. Applied Sciences, 12(3), 1648. https://doi.org/10.3390/APP12031648.
Search in Google Scholar Back to article
Fursich, B., Bamler, R., Augustin, S., Hubers, H.W., Zhu, X.X. (2016) Towards single-pixel FMCW radar reconstruction. In: Proceedings of 4th International Workshop on Compressed Sensing Theory and its Applications to Radar, Sonar and Remote Sensing (CoSeRa), Aachen, September 2016. IEEE, pp. 95–99. https://doi.org/10.1109/COSERA.2016.7745707.
Search in Google Scholar Back to article
Hu, M., Li, Z., Yu, J., Wan, X., Tan, H., Lin, Z. (2023) Efficient-lightweight YOLO: Improving small object detection in YOLO for aerial images. Sensors, 23(14), 6423. https://doi.org/10.3390/S23146423.
Search in Google Scholar Back to article
Huo, Z., Yan, T., Cao, W. (2021) Fast small object detection algorithm based on feature enhancement and reconstruction. In: Proceedings of 13th International Conference on Wireless Communications and Signal Processing (WCSP), Changsha, October 2021. IEEE, 1-5. https://doi.org/10.1109/WCSP52459.2021.9613660.
Search in Google Scholar Back to article
Federal Aviation Administration. (2011) Introduction to TCAS II Version 7.1. U.S. Department of Transportation.
Search in Google Scholar Back to article
Jabłoński, B., Makowski, D., Perek, P., Nowakowski, P.N.V., Sitjes, A.P., Jakubowski, M., Gao, Y., Winter, A. (2022) Evaluation of NVIDIA Xavier NX platform for real-time image processing for plasma diagnostics. Energies, 15(6), 2088. https://doi.org/10.3390/EN15062088
Search in Google Scholar Back to article
Kateb, F.A., Monowar, M.M., Hamid, M.A., Ohi, A.Q., Mridha, M.F. (2021) FruitDet: Attentive feature aggregation for real-time fruit detection in orchards. Agronomy, 11(12), 2440. https://doi.org/10.3390/AGRONOMY11122440
Search in Google Scholar Back to article
Kulisz, M., Kłosowski, G., Rymarczyk, T., Hoła, A., Niderla, K., Sikora, J. I. (2024) The use of the multi-sequential LSTM in electrical tomography for masonry wall moisture detection. Measurement, 234, 114860. https://doi.org/10.1016/J.MEASUREMENT.2024.114860.
Search in Google Scholar Back to article
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., Dolí, P. (2014) Microsoft COCO: Common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, 8693. Springer, Cham. https://doi.org/10.1007/978-3-319-10602-1_48.
Search in Google Scholar Back to article
Liu, S., Huang, D., Wang, Y. (2019) Learning spatial fusion for single-shot object detection. 10.48550/arXiv.1911.09516.
Search in Google Scholar Back to article
Maas, J., van Gent, R., Hoekstra, J. (2020) A portable primary radar for general aviation. PLoS One, 15(10), e0239892. https://doi.org/10.1371/JOURNAL.PONE.0239892.
Search in Google Scholar Back to article
PyTorch (2024) PyTorch Foundation. Available at https://pytorch.org/ (accessed 10.18.24).
Search in Google Scholar Back to article
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B. (2021) High-resolution image synthesis with latent diffusion models. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, June 2022. IEEE, 10674-10685. https://doi.org/10.1109/CVPR52688.2022.01042.
Search in Google Scholar Back to article
Smyers, E.Q., Katz, S.M., Corso, A.L., Kochenderfer, M.J. (2023) AVOIDDS: Aircraft vision-based intruder detection dataset and simulator. Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track. https://doi.org/10.48550/arXiv.2306.11203.
Search in Google Scholar Back to article
Tan, M., Pang, R., Le, Q. V. (2020) EfficientDet: Scalable and efficient object detection. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, June 2020. IEEE, pp. 10778-10787. https://doi.org/10.1109/CVPR42600.2020.01079.
Search in Google Scholar Back to article
Tang, J. (2017) Review: Analysis and improvement of traffic alert and collision avoidance system. IEEE Access, 5, 21419–21429. https://doi.org/10.1109/ACCESS.2017.2757598.
Search in Google Scholar Back to article
Terven, J.R., Cordova-Esparza, D.M. (2023) A comprehensive review of YOLO architectures in computer vision: From YOLOv1 to YOLOv8 and YOLO-NAS. Machine Learning and Knowledge Extraction, 5(4), 1680-1716. https://doi.org/10.3390/make5040083.
Search in Google Scholar Back to article
Tong, K., Wu, Y. (2024) I-YOLO: A novel single-stage framework for small object detection. The Visual Computer, 40(12). doi: 8927-8944. 10.1007/s00371-024-03284-8.
Search in Google Scholar Back to article
Yang, G., Lei, J., Zhu, Z., Cheng, S., Feng, Z., Liang, R. (2023) AFPN: Asymptotic feature pyramid network for object detection. In: Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC), Honolulu, October 2023. IEEE, 2184-2189. https://doi.org/10.1109/SMC53992.2023.10394415.
Search in Google Scholar Back to article
Yang, Z., Kang, X., Gong, Y., Wang, J. (2023) Aircraft trajectory prediction and aviation safety in ADS-B failure conditions based on neural network. Scientific Reports, 13, 19677. https://doi.org/10.1038/s41598-023-46914-2.
Search in Google Scholar Back to article
Zhai, X., Huang, Z., Li, T., Liu, H., Wang, S. (2023) YOLO-drone: An optimized YOLOv8 network for tiny UAV object detection. Electronics, 12(17), 3664. https://doi.org/10.3390/ELECTRONICS12173664.
Search in Google Scholar Back to article

Aircraft Pilot Assistance System: Detection of Other Aircraft Using Artificial Neural Networks

Abstract

Paradigm

My account