A Holistic Approach to Multi-Modal Skin Lesion Diagnosis Supported by Statistical and Explainability-Based Investigation of Artifacts
References
- International Agency for Research on Cancer, Cancer TODAY (version 1.1), 2024.
- U. Leiter, T. Eigentler, and C. Garbe, Epidemiology of Skin Cancer, in Sunlight, Vitamin D and Skin Cancer, pp. 120–140, New York, NY: Springer, 2014.
- SEER, Melanoma of the skin – Cancer stat facts, 2022.
- F. Nachbar, W. Stolz, T. Merkle, A. B. Cognetta, T. Vogt, M. Landthaler, P. Bilek, O. Braun-Falco, and G. Plewig, The ABCD rule of dermatoscopy: high prospective value in the diagnosis of doubtful melanocytic skin lesions, Journal of the American Academy of Dermatology, vol. 30, no. 4, pp. 551–559, 1994.
- R. H. Johr, Dermoscopy: alternative melanocytic algorithms—the ABCD rule of dermatoscopy, menzies scoring method, and 7-point checklist, Clinics in Dermatology, vol. 20, no. 3, pp. 240–247, 2002.
- J. S. Henning, S. W. Dusza, S. Q. Wang, A. A. Marghoob, H. S. Rabinovitz, D. Polsky, and A. W. Kopf, The CASH (color, architecture, symmetry, and homogeneity) algorithm for dermoscopy, Journal of the American Academy of Dermatology, vol. 56, no. 1, pp. 45–52, 2007.
- P. Tschandl, C. Rosendahl, and H. Kittler, The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions, Scientific Data, 2018. Publisher: Nature Publishing Group.
- ViDIR Group, Department of Dermatology, Medical University of Vienna, The HAM10000, 2018. version 4.
- M. Sundararajan, A. Taly, and Q. Yan, Axiomatic attribution for deep networks, in Proceedings of the 34th International Conference on Machine Learning, pp. 3319–3328, PMLR, 2017.
- T. J. Brinker, A. Hekler, J. S. Utikal, N. Grabe, D. Schadendorf, J. Klode, C. Berking, T. Steeb, A. H. Enk, and C. Von Kalle, Skin cancer classification using convolutional neural networks: systematic review, Journal of Medical Internet Research, vol. 20, no. 10, p. e11936, 2018.
- S. Haggenmüller, R. C. Maron, A. Hekler, J. S. Utikal, C. Barata, R. L. Barnhill, H. Beltraminelli, C. Berking, B. Betz-Stablein, A. Blum, S. A. Braun, R. Carr, M. Combalia, M.-T. Fernandez-Figueras, G. Ferrara, S. Fraitag, L. E. French, F. F. Gellrich, K. Ghoreschi, M. Goebeler, P. Guitera, H. A. Haenssle, S. Haferkamp, L. Heinzerling, M. V. Heppt, F. J. Hilke, S. Hobelsberger, D. Krahl, H. Kutzner, A. Lallas, K. Liopyris, M. Llamas-Velasco, J. Malvehy, F. Meier, C. S. L. Müller, A. A. Navarini, C. Navarrete-Dechent, A. Perasole, G. Poch, S. Podlipnik, L. Requena, V. M. Rotemberg, A. Saggini, O. P. Sangueza, C. Santonja, D. Schadendorf, B. Schilling, M. Schlaak, J. G. Schlager, M. Sergon, W. Sondermann, H. P. Soyer, H. Starz, W. Stolz, E. Vale, W. Weyers, A. Zink, E. Krieghoff-Henning, J. N. Kather, C. von Kalle, D. B. Lipka, S. Fröhling, A. Hauschild, H. Kittler, and T. J. Brinker, Skin cancer classification via convolutional neural networks: systematic review of studies involving human experts, European Journal of Cancer, pp. 202–216, 2021.
- H. Bhatt, V. Shah, K. Shah, R. Shah, and M. Shah, State-of-the-art machine learning techniques for melanoma skin cancer detection and classification: a comprehensive review, Intelligent Medicine, vol. 3, no. 03, pp. 180–190, 2023.
- K. Polat and O. Koc, Detection of skin diseases from dermoscopy image using the combination of convolutional neural network and one-versus-all, Journal of Artificial Intelligence and Systems, vol. 2, no. 1, pp. 80–97, 2020.
- S. S. Chaturvedi, J. V. Tembhurne, and T. Diwan, A multi-class skin Cancer classification using deep convolutional neural networks, Multimedia Tools and Applications, vol. 79, no. 39, pp. 28477–28498, 2020.
- M. Kumar, M. Alshehri, R. AlGhamdi, P. Sharma, and V. Deep, A de-ann inspired skin cancer detection approach using fuzzy c-means clustering, Mobile Networks and Applications, vol. 25, pp. 1319–1329, 2020.
- B. Shetty, R. Fernandes, A. P. Rodrigues, R. Chen-goden, S. Bhattacharya, and K. Lakshmanna, Skin lesion classification of dermoscopic images using machine learning and convolutional neural network, Scientific Reports, vol. 12, no. 1, p. 18134, 2022.
- S. K. Datta, M. A. Shaikh, S. N. Srihari, and M. Gao, Soft attention improves skin cancer classification performance, in Interpretability of Machine Intelligence in Medical Image Computing, and Topological Data Analysis and Its Applications for Medical Data: 4th International Workshop, iMIMIC 2021, and 1st International Workshop, TDA4MedicalData 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 4, (Cham), pp. 13–23, Springer, 2021.
- D. N. H. Thanh, V. B. S. Prasath, L. M. Hieu, and N. N. Hien, Melanoma skin cancer detection method based on adaptive principal curvature, colour normalisation and feature extraction with the ABCD rule, Journal of Digital Imaging, vol. 33, no. 3, pp. 574–585, 2020.
- Z. Wang, C. Wang, L. Peng, K. Lin, Y. Xue, X. Chen, L. Bao, C. Liu, J. Zhang, and Y. Xie, Radiomic and deep learning analysis of dermoscopic images for skin lesion pattern decoding, Scientific Reports, vol. 14, p. 19781, 2024.
- A. C. Foahom Gouabou, J.-L. Damoiseaux, J. Monnier, R. Iguernaissi, A. Moudafi, and D. Merad, Ensemble method of convolutional neural networks with directed acyclic graph using dermoscopic images: melanoma detection application, Sensors, vol. 21, no. 12, p. 3999, 2021.
- A. C. Foahom Gouabou, J. Collenne, J. Monnier, R. Iguernaissi, J.-L. Damoiseaux, A. Moudafi, and D. Merad, Computer aided diagnosis of melanoma using deep neural networks and game theory: application on dermoscopic images of skin lesions, International Journal of Molecular Sciences, vol. 23, no. 22, p. 13838, 2022.
- A. Bissoto, F. Perez, V. Ribeiro, M. Fornaciali, S. Avila, and E. Valle, Deep-learning ensembles for skin-lesion segmentation, analysis, classification: RECOD titans at isic challenge 2018, 2018. arXiv:1808.08480 [cs].
- A. Mahbod, G. Schaefer, C. Wang, G. Dorffner, R. Ecker, and I. Ellinger, Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification, Computer Methods and Programs in Biomedicine, vol. 193, p. 105475, 2020.
- C. Barata, M. E. Celebi, and J. S. Marques, Explainable skin lesion diagnosis using taxonomies, Pattern Recognition, vol. 110, p. 107413, 2021.
- B. Cassidy, C. Kendrick, A. Brodzicki, J. Jaworek-Korjakowska, and M. H. Yap, Analysis of the ISIC image datasets: Usage, benchmarks and recommendations, Medical Image Analysis, vol. 75, p. 102305, 2022.
- C. Barata, V. Rotemberg, N. C. F. Codella, P. Tschandl, C. Rinner, B. N. Akay, Z. Apalla, G. Argenziano, A. Halpern, A. Lallas, C. Longo, J. Malvehy, S. Puig, C. Rosendahl, H. P. Soyer, I. Zalaudek, and H. Kittler, A reinforcement learning model for AI-based decision support in skin cancer, Nature Medicine, vol. 29, no. 8, pp. 1941–1946, 2023. Publisher: Nature Publishing Group.
- Anonymous, MSK Dataset, 2018.
- N. Codella, V. Rotemberg, P. Tschandl, M. E. Celebi, S. Dusza, D. Gutman, B. Helba, A. Kalloo, K. Liopyris, M. Marchetti, H. Kittler, and A. Halpern, Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (ISIC), 2019.
- J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, ImageNet: A large-scale hierarchical image database, in 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, 2009. ISSN: 1063-6919.
- O. Ronneberger, P. Fischer, and T. Brox, U-net: Convolutional networks for biomedical image segmentation, in Medical Image Computing and Computer-assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pp. 234–241, Springer International Publishing, 2015.
- Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, UNet++: A Nested U-Net Architecture for Medical Image Segmentation, in Deep Learning in Medical Image Analysis and Multi-modal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4, (Cham), pp. 3–11, Springer International Publishing, 2018.
- L.-C. Chen, Y. Zhu, G. Papandreou, F. Schroff, and H. Adam, Encoder-decoder with atrous separable convolution for semantic image segmentation, in Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818, 2018.
- M. Tan and Q. Le, Efficientnet: Rethinking model scaling for convolutional neural networks, in Proceedings of the 36th International Conference on Machine Learning, pp. 6105–6114, PMLR, 2019. ISSN: 2640-3498.
- K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778, 2016.
- G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger, Densely connected convolutional networks, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708, 2017.
- R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, Grad-CAM: Visual Explanations From Deep Networks via Gradient-Based Localization, in Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626, 2017.
- C. Scapicchio, M. Gabelloni, A. Barucci, D. Cioni, L. Saba, and E. Neri, A deep look into radiomics, La Radiologia Medica, vol. 126, no. 10, pp. 1296–1311, 2021.
- A. Zwanenburg, M. Vallières, M. A. Abdalah, H. J. W. L. Aerts, V. Andrearczyk, A. Apte, S. Ashrafinia, S. Bakas, R. J. Beukinga, R. Boellaard, M. Bogowicz, L. Boldrini, I. Buvat, G. J. R. Cook, C. Davatzikos, A. Depeursinge, M.-C. Desseroit, N. Dinapoli, C. V. Dinh, S. Echegaray, I. El Naqa, A. Y. Fedorov, R. Gatta, R. J. Gillies, V. Goh, M. Götz, M. Guckenberger, S. M. Ha, M. Hatt, F. Isensee, P. Lambin, S. Leger, R. T. Leijenaar, J. Lenkowicz, F. Lippert, A. Losnegård, K. H. Maier-Hein, O. Morin, H. Müller, S. Napel, C. Nioche, F. Orlhac, S. Pati, E. A. Pfaehler, A. Rahmim, A. U. Rao, J. Scherer, M. M. Siddique, N. M. Sijtsema, J. Socarras Fernandez, R. J. Spezi, Emiliano and, S. Tanadini-Lang, D. Thorwarth, E. G. Troost, T. Upadhaya, V. Valentini, L. V. van Dijk, J. van Griethuysen, F. H. van Velden, P. Whybra, C. Richter, and S. Löck, The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping, Radiology, vol. 295, no. 2, pp. 328–338, 2020. Publisher: Radiological Society of North America.
- S. O. Arik and T. Pfister, TabNet: Attentive Interpretable Tabular Learning, in Proceedings of the AAAI Conference on Artificial Intelligence, pp. 6679–6687, 2021.
- R. Tibshirani, Regression Shrinkage and Selection Via the Lasso,” Journal of the Royal Statistical Society: Series B (Methodological), vol. 58, no. 1, pp. 267–288, 1996.
- S. M. Lundberg and S.-I. Lee, A unified approach to interpreting model predictions, in Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, (Red Hook, NY, USA), pp. 4768–4777, Curran Associates Inc., 2017.
- K. Brzozowski, J. Buler, R. Buler, and M. Grochowski, Comprehensive Quantitative Evaluation of the Performance and Trustworthiness of Deep Learning Models - Skin Lesion Classification Case Study, in 2025 29th International Conference on Methods and Models in Automation and Robotics (MMAR), pp. 345–350, Aug. 2025. ISSN: 2835-2807.
- C. E. Shannon, A mathematical theory of communication, Bell System Technical Journal, vol. 27, no. 3, 1948.
- G. E. Batista, A. L. Bazzan, M. C. Monard, and others, Balancing training data for automated annotation of keywords: a case study., Wob, vol. 4, pp. 10–18, 2003.
- N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, Smote: synthetic minority over-sampling technique, Journal of Artificial Intelligence Research, vol. 16, no. 1, p. 321, 2002.
- A. Mikołajczyk, M. Grochowski, and A. Kwasigroch, Towards Explainable Classifiers Using the Counterfactual Approach - Global Explanations for Discovering Bias in Data, Journal of Artificial Intelligence and Soft Computing Research, vol. 11, no. 1, pp. 51–67, 2021.
- A. Mikołajczyk-Bareła, M. Ferlin, and M. Grochowski, Targeted data augmentation for improving model robustness, International Journal of Applied Mathematics and Computer Science, vol. 35, no. 1, pp. 143–155, 2025.
- N. M. Kinyanjui, T. Odonga, C. Cintas, N. C. Codella, R. Panda, P. Sattigeri, and K. R. Varshney, Estimating skin tone and effects on classification performance in dermatology datasets, arXiv preprint arXiv:1910.13268, 2019.
- A. Shahzaib, A. B. Siddiqui, N. Anjum, M. U. Rehman, and N. Ramzan, Hair removal and lesion segmentation of dermoscopic images for classification of skin cancer using deep neural networks, Egyptian Informatics Journal, vol. 32, p. 100844, Dec. 2025.
- T. Lee, V. Ng, R. Gallagher, A. Coldman, and D. McLean, Dullrazor®: A software approach to hair removal from images, Computers in Biology and Medicine, vol. 27, pp. 533–543, Nov. 1997.
- Q. Abbas, M. E. Celebi, and I. F. García, Hair removal methods: A comparative study for dermoscopy images, Biomedical Signal Processing and Control, vol. 6, pp. 395–404, Oct. 2011.
- P. Bibiloni, M. González-Hidalgo, and S. Massanet, Skin Hair Removal in Dermoscopic Images Using Soft Color Morphology, in Artificial Intelligence in Medicine (A. ten Teije, C. Popow, J. H. Holmes, and L. Sacchi, eds.), (Cham), pp. 322–326, Springer International Publishing, 2017.
- A. Huang, S.-Y. Kwan, W.-Y. Chang, M.-Y. Liu, M.-H. Chi, and G.-S. Chen, A robust hair segmentation and removal approach for clinical images of skin lesions, in 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3315–3318, July 2013. ISSN: 1558-4615.
- F.-Y. Xie, S.-Y. Qin, Z.-G. Jiang, and R.-S. Meng, PDE-based unsupervised repair of hair-occluded information in dermoscopy images of melanoma, Computerized Medical Imaging and Graphics, vol. 33, pp. 275–282, June 2009.
- J. Buler, R. Buler, K. Brzozowski, and M. Grochowski, ISIC-2018 Challenge Task 3 (Artifact-Plus), 2026. [Data set].
- K. Brzozowski, M. Bobowicz, J. Buler, R. Buler, and M. Grochowski, ISIC-2018 Task 3 Test Set (Auto-Segmentation Masks), 2026. [Data set].
Language: English
Page range: 315 - 342
Submitted on: Jul 19, 2025
Accepted on: May 11, 2026
Published on: Jun 29, 2026
Published by: SAN University
In partnership with: Paradigm Publishing Services
Keywords:
Related subjects:
© 2026 Jakub Buler, Rafał Buler, Krystian Brzozowski, Maria Ferlin, Maciej Bobowicz, Michał Grochowski, published by SAN University
This work is licensed under the Creative Commons Attribution 4.0 License.