Skin Lesion Segmentation and Multiclass Classification Using Deep Learning Features and Improved Moth Flame Optimization

Diagnostics - Tập 11 Số 5 - Trang 811
Muhammad Attique Khan1, Muhammad Sharif1, Tallha Akram2, Robertas Damaševičius3, Rytis Maskeliūnas4
1Department of Computer Science, Wah Campus, COMSATS University Islamabad, Wah Cantonment 47040, Pakistan
2Department of Electrical Engineering, Wah Campus, COMSATS University Islamabad, Islamabad 45550, Pakistan
3Faculty of Applied Mathematics, Silesian University of Technology, 44-100, Gliwice, Poland
4Department of Applied Informatics, Vytautas Magnus University, 44404 Kaunas, Lithuania

Tóm tắt

Manual diagnosis of skin cancer is time-consuming and expensive; therefore, it is essential to develop automated diagnostics methods with the ability to classify multiclass skin lesions with greater accuracy. We propose a fully automated approach for multiclass skin lesion segmentation and classification by using the most discriminant deep features. First, the input images are initially enhanced using local color-controlled histogram intensity values (LCcHIV). Next, saliency is estimated using a novel Deep Saliency Segmentation method, which uses a custom convolutional neural network (CNN) of ten layers. The generated heat map is converted into a binary image using a thresholding function. Next, the segmented color lesion images are used for feature extraction by a deep pre-trained CNN model. To avoid the curse of dimensionality, we implement an improved moth flame optimization (IMFO) algorithm to select the most discriminant features. The resultant features are fused using a multiset maximum correlation analysis (MMCA) and classified using the Kernel Extreme Learning Machine (KELM) classifier. The segmentation performance of the proposed methodology is analyzed on ISBI 2016, ISBI 2017, ISIC 2018, and PH2 datasets, achieving an accuracy of 95.38%, 95.79%, 92.69%, and 98.70%, respectively. The classification performance is evaluated on the HAM10000 dataset and achieved an accuracy of 90.67%. To prove the effectiveness of the proposed methods, we present a comparison with the state-of-the-art techniques.

Từ khóa


Tài liệu tham khảo

Barata, 2021, Explainable skin lesion diagnosis using taxonomies, Pattern Recognit., 110, 107413, 10.1016/j.patcog.2020.107413

Liu, L., Tsui, Y.Y., and Mandal, M. (2021). Skin lesion segmentation using deep learning with auxiliary task. J. Imaging, 7.

Mohapatra, S., Abhishek, N.V.S., Bardhan, D., Ghosh, A.A., and Mohanty, S. (2020). Skin cancer classification using convolution neural networks. Lecture Notes in Networks and Systems, Springer.

Rogers, 2015, Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the US Population, 2012, JAMA Dermatol., 151, 1081, 10.1001/jamadermatol.2015.1187

Guy, 2015, Prevalence and costs of skin cancer treatment in the U.S.; 2002−2006 and 2007−2011, Am. J. Prev. Med., 48, 183, 10.1016/j.amepre.2014.08.036

American Cancer Society (2020, August 22). Annual Cancer Facts and Figures. Available online: https://www.cancer.org/content/dam/cancer-org/research/cancer-facts-and-statistics/annual-cancer-facts-and-figures/2020/cancer-facts-and-figures-2020.pdf.

Siegel, 2019, Cancer statistics, 2019, CA Cancer J. Clin., 69, 7, 10.3322/caac.21551

Bandic, 2020, Teledermoscopy for skin cancer prevention: A comparative study of clinical and teledermoscopic diagnosis, Acta Inform. Med., 28, 37, 10.5455/aim.2020.28.37-41

Argenziano, G., Fabbrocini, G., Carli, P., De Giorgi, V., Sammarco, E., and Delfino, M. (1998). Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Arch. Dermatol., 134.

Singh, 2019, FCA-net: Adversarial learning for skin lesion segmentation based on multi-scale features and factorized channel attention, IEEE Access, 7, 130552, 10.1109/ACCESS.2019.2940418

Celebi, 2019, Dermoscopy image analysis: Overview and future directions, IEEE J. Biomed. Health Inform., 23, 474, 10.1109/JBHI.2019.2895803

Vestergaard, M.E., Macaskill, P., Holt, P.E., and Menzies, S.W. (2008). Dermoscopy compared with naked eye examination for the diagnosis of primary melanoma: A meta-analysis of studies performed in a clinical setting. Br. J. Dermatol., 669–676.

Barata, 2019, A survey of feature extraction in dermoscopy image analysis of skin cancer, IEEE J. Biomed. Health Inform., 23, 1096, 10.1109/JBHI.2018.2845939

Kassem, 2020, Skin lesions classification into eight classes for ISIC 2019 using deep convolutional neural network and transfer learning, IEEE Access, 8, 114822, 10.1109/ACCESS.2020.3003890

Szaleniec, 2014, Outcome prediction in endoscopic surgery for chronic rhinosinusitis—A multidimensional model, Adv. Med. Sci., 59, 13, 10.1016/j.advms.2013.06.003

Piekarski, 2020, Convolutional neural network architecture for beam instabilities identification in Synchrotron Radiation Systems as an anomaly detection problem, Measurement, 165, 108116, 10.1016/j.measurement.2020.108116

Nisa, M., Shah, J.H., Kanwal, S., Raza, M., Khan, M.A., Damaševičius, R., and Blažauskas, T. (2020). Hybrid malware classification method using segmentation-based fractal texture analysis and deep convolution neural network features. Appl. Sci., 10.

Wei, 2019, Attention-based DenseUnet network with adversarial training for skin lesion segmentation, IEEE Access, 7, 136616, 10.1109/ACCESS.2019.2940794

Khan, 2019, An integrated framework of skin lesion detection and recognition through saliency method and optimal deep neural network features selection, Neural Comput. Appl., 32, 15929, 10.1007/s00521-019-04514-0

Esteva, 2017, Dermatologist-level classification of skin cancer with deep neural networks, Nature, 542, 115, 10.1038/nature21056

Glowacz, 2016, Recognition of images of finger skin with application of histogram, image filtration and K-NN classifier, Biocybern. Biomed. Eng., 36, 95, 10.1016/j.bbe.2015.12.005

Tang, J., Alelyani, S., and Liu, H. (2014). Feature selection for classification: A review. Data Classification: Algorithms and Applications, CRC Press.

Tschandl, P., Rosendahl, C., and Kittler, H. (2018). The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data, 5.

Gutman, D., Codella, N.C., Celebi, E., Helba, B., Marchetti, M., Mishra, N., and Halpern, A. (2016). Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). arXiv.

Codella, N.C., Gutman, D., Celebi, M.E., Helba, B., Marchetti, M.A., Dusza, S.W., Kalloo, A., Liopyris, K., Mishra, N., and Kittler, H. (2018, January 4–7). Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.

Codella, N., Rotemberg, V., Tschandl, P., Celebi, M.E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., and Marchetti, M. (2019). Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (ISIC). arXiv.

Mendonca, T., Celebi, M., Mendonca, T., and Marques, J. (2015). Ph2: A public database for the analysis of dermoscopic images. Dermoscopy Image Analysis, CRC Press.

He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.

Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.

Khan, M.A., Akram, T., Sharif, M., Shahzad, A., Aurangzeb, K., Alhussein, M., Haider, S.I., and Altamrah, A. (2018). An implementation of normal distribution based segmentation and entropy controlled features selection for skin lesion detection and classification. BMC Cancer, 18.

Tschandl, 2019, Domain-specific classification-pretrained fully convolutional network encoders for skin lesion segmentation, Comput. Biol. Med., 104, 111, 10.1016/j.compbiomed.2018.11.010

Mahbod, 2020, Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification, Comput. Methods Programs Biomed., 193, 105475, 10.1016/j.cmpb.2020.105475

Harangi, 2020, Assisted deep learning framework for multi-class skin lesion classification considering a binary classification support, Biomed. Signal Process. Control, 62, 102041, 10.1016/j.bspc.2020.102041

Chaturvedi, 2020, A multi-class skin Cancer classification using deep convolutional neural networks, Multimed. Tools Appl., 79, 28477, 10.1007/s11042-020-09388-2

Kim, 2020, Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification, Comput. Methods Programs Biomed., 190, 105351, 10.1016/j.cmpb.2020.105351

Xie, 2020, A mutual bootstrapping model for automated skin lesion segmentation and classification, IEEE Trans. Med. Imaging, 39, 2482, 10.1109/TMI.2020.2972964

Jayapriya, 2019, Hybrid fully convolutional networks-based skin lesion segmentation and melanoma detection using deep feature, Int. J. Imaging Syst. Technol., 30, 348, 10.1002/ima.22377

Russakovsky, 2015, ImageNet large scale visual recognition challenge, Int. J. Comput. Vis., 115, 211, 10.1007/s11263-015-0816-y

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–15). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.

Xie, 2020, Skin lesion segmentation using high-resolution convolutional neural network, Comput. Methods Programs Biomed., 186, 105241, 10.1016/j.cmpb.2019.105241

Miglani, V., and Bhatia, M. (2020, January 13–15). Skin lesion classification: A transfer learning approach using efficientnets. Proceedings of the International Conference on Advanced Machine Learning Technologies and Applications (AMLTA 2020), Jaipur, India.

Mahbod, 2019, Fusing fine-tuned deep features for skin lesion classification, Comput. Med. Imaging Graph., 71, 19, 10.1016/j.compmedimag.2018.10.007

Mahbod, A., Tschandl, P., Langs, G., Ecker, R., and Ellinger, I. (2020). The effects of skin lesion segmentation on the performance of dermatoscopic image classification. Comput. Methods Programs Biomed., 197.

Kim, 1997, Contrast enhancement using brightness preserving bi-histogram equalization, IEEE Trans. Consum. Electron., 43, 1, 10.1109/30.580378

Akram, T., Khan, M.A., Sharif, M., and Yasmin, M. (2018). Skin lesion segmentation and recognition using multichannel saliency estimation and M-SVM on selected serially fused features. J. Ambient Intell. Humaniz. Comput.

Ahn, 2017, Saliency-Based Lesion Segmentation via Background Detection in Dermoscopic Images, IEEE J. Biomed. Health Inform., 21, 1685, 10.1109/JBHI.2017.2653179

Awan, M.J., Mohd Rahim, M.S., Salim, N., Mohammed, M.A., Garcia-Zapirain, B., and Abdulkareem, K.H. (2021). Efficient detection of knee anterior cruciate ligament from magnetic resonance imaging using deep learning approach. Diagnostics, 11.

Tu, 2019, Dense-residual network with adversarial learning for skin lesion segmentation, IEEE Access, 7, 77037, 10.1109/ACCESS.2019.2921815

Fan, 2017, Automatic segmentation of dermoscopy images using saliency combined with Otsu threshold, Comput. Biol. Med., 85, 75, 10.1016/j.compbiomed.2017.03.025

Achanta, 2012, SLIC Superpixels Compared to State-of-the-Art Superpixel Methods, IEEE Trans. Pattern Anal. Mach. Intell., 34, 2274, 10.1109/TPAMI.2012.120

Wang, 2020, DenseNet-201-Based Deep Neural Network with Composite Learning Factor and Precomputation for Multiple Sclerosis Classification, ACM Trans. Multimed. Comput. Commun. Appl., 16, 1

Zhuang, 2021, A comprehensive survey on transfer learning, Proc. IEEE, 109, 43, 10.1109/JPROC.2020.3004555

Urbonas, A., Raudonis, V., Maskeliunas, R., and Damaševičius, R. (2019). Automated identification of wood veneer surface defects using faster region-based convolutional neural network with data augmentation and transfer learning. Appl. Sci., 9.

Nanni, L., Interlenghi, M., Brahnam, S., Salvatore, C., Papa, S., Nemni, R., and Castiglioni, I. (2020). Comparison of transfer learning and conventional machine learning applied to structural brain MRI for the early diagnosis and prognosis of alzheimer’s disease. Front. Neurol., 11.

Rehman, Z.U., Khan, M.A., Ahmed, F., Damaševičius, R., Naqvi, S.R., Nisar, W., and Javed, K. (2021). Recognizing apple leaf diseases using a novel parallel real-time processing framework based on MASK RCNN and transfer learning: An application for smart agriculture. IET Image Process.

Khan, M.A., Ashraf, I., Alhaisoni, M., Damaševičius, R., Scherer, R., Rehman, A., and Bukhari, S.A.C. (2020). Multimodal brain tumor classification using deep learning and robust feature selection: A machine learning application for radiologists. Diagnostics, 10.

Elaziz, 2020, Opposition-based moth-flame optimization improved by differential evolution for feature selection, Math. Comput. Simul., 168, 48, 10.1016/j.matcom.2019.06.017

Mirjalili, 2015, Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm, Knowl. Based Syst., 89, 228, 10.1016/j.knosys.2015.07.006

Jaeschke, D. (1979). The asymptotic distribution of the supremum of the standardized empirical distribution function on subintervals. Ann. Stat., 7.

Liu, 2015, Multiple kernel extreme learning machine, Neurocomputing, 149, 253, 10.1016/j.neucom.2013.09.072

Rehman, 2020, Microscopic melanoma detection and classification: A framework of pixel-based fusion and multilevel features reduction, Microsc. Res. Tech., 83, 410, 10.1002/jemt.23429

Saba, T., Khan, M.A., Rehman, A., and Marie-Sainte, S.L. (2019). Region extraction and classification of skin cancer: A heterogeneous framework of deep CNN features fusion and reduction. J. Med. Syst., 43.

Bi, 2019, Step-wise integration of deep class-specific learning for dermoscopic image segmentation, Pattern Recognit., 85, 78, 10.1016/j.patcog.2018.08.001

Chaturvedi, S.S., Gupta, K., and Prasad, P.S. (2020). Skin lesion analyser: An efficient seven-way multi-class skin cancer classification using mobilenet. Advances in Intelligent Systems and Computing, Springer.

Thông tin
Thông tin xuất bản

Diagnostics

Tập 11 Số 5

811

Thông tin tác giả