A survey on machine learning based brain retrieval algorithms in medical image analysis
Tóm tắt
In recent times, researchers showed huge interest in machine learning approaches that attempts to develop the information representations via computational modules. Past decade gained momentum by deep learning approaches and their potential of enhancing the performance for numerous automation operations with superior future research applications. The novelties in medical image processing initialized the unique perspective to diagnose the human body with superior resolution and enhanced accuracy. This paper offers a comprehensive work on existing methodologies that attain optimum results in their respective domains. There exist various Magnetic Resonance Imaging (MRI) brain scan classifiers to obtain efficient features extraction images. The fundamental step in these methods includes several actions to be performed by using different approaches in order to characterize the anomalous developments in MRI scans of brain. Mostly, current techniques are utilizing deep learning feature extraction algorithm from MRI brain scans to obtain their relevant features. Currently, deep learning algorithms associated with medical imaging results in achieving remarkable performance enhancement in diagnosis as well as characterization of complex pathologies in case of brain tumors. This paper provides existing research gaps in identification, segmentation and feature extraction among current approaches. This paper also suggests the future directions to increase the efficiency of current models.
Tài liệu tham khảo
De Angelis LM. Brain tumors. New England J Med. Jan. 2001;344(2):114–23.
Stewart BW, Wild CP. World cancer report 2014. Lyon, France: IARC; 2014.
C. P. Wild, E. Weiderpass, B. W. Stewart, World cancer report: cancer research for Cancer prevention, world cancer reports, ISBN: 978-92-832-0447-3, 2020.
Behin A, Hoang-Xuan K, Carpentier AF, Delattre J-Y. Primary brain tumours in adults. Lancet. 2003;361(9354):323–31.
Drevelegas A. Imaging of brain tumors with histological correlations. Berlin, Germany: Springer; 2002.
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, et al. A survey on deep learning in medical image analysis. Med Image Anal. Dec. 2017;42:60–88.
Goodenberger ML, Jenkins RB. Genetics of adult glioma. Cancer Genet. Dec. 2012;205(12):613–21.
Louis DN, Perry A, Reifenberger G, von Deimling A, Figarella-Branger D, Cavenee WK, et al. The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol. Jun. 2016;131(6):803–20.
Bishop C. Pattern recognition and machine learning. Berlin, Germany: Springer-Verlag; 2006.
H. H. Sultan, N. M. Salem and W. AL-ATABANYSSM, “Multi-Classification of Brain Tumor Images Using Deep Neural Network”, Special Section On Deep Learning For Computer-Aided Medical Diagnosis, vol. 7, 2019.
T. Rajesh and R. S. M. Malar, “Rough set theory and feed forward neural network based brain tumor detection in magnetic resonance images”, in Proc. Int. Conf. Adv. Nanomaterials Emerg. Eng. Technol. (ICANMEET), Jul. 2013, pp. 240–244.
K. Machhale, H. B. Nandpuru, V. Kapur, and L. Kosta, “MRI brain cancer classication using hybrid classier (SVM-KNN)”, in Proc. Int. Conf. Ind. Instrum. Control (ICIC), May 2015, pp. 60–65.
M. Shasidhar, V. S. Raja, and B. V. Kumar. MRI brain image segmentation using modied fuzzy C-means clustering algorithm. in Proc Int Conf Commun Syst Netw Technol (CSNT), Jun. 2011, pp. 473–478.
S. Goswami and L. K. P. Bhaiya. Brain tumour detection using unsupervised learning based neural network. in Proc Int Conf Commun Syst Netw Technol (CSNT), Apr. 2013, pp. 573–577.
S. Khalid, T. Khalil, and S. Nasreen. A survey of feature selection and feature extraction techniques in machine learning, in Proc Sci Inf Conf, Aug. 2014, pp. 372–378.
Deng L, Yu D. Deep learning: Methods and applications. Found Trends Signal Process. Jun. 2014;7(34):197–387.
Y. LeCun. (2015). Lenet-5, convolutional neural networks. Accessed: May 2019. [online]. Available: http://yann.lecun.com/exdb/lenet.
Matsugu M, Mori K, Mitari Y, Kaneda Y. Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw. Jul. 2003;16(56):555–9.
LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436.
LeCun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proc IEEE. Nov. 1998;86(11):2278–324.
A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks, in Proc Adv Neural Inf Process Syst (NIPS), Jan. 2012, pp. 1097–1105.
Zacharaki EI, Wang S, Chawla S, Yoo DS, Wolf R, Melhem ER, et al. Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme. Magn Reson Med. Dec. 2009;62(6):1609–18.
El-Dahshan ESA, Hosny T, Salem ABM. Hybrid intelligent techniques for MRI brain images classification. Digit Signal Process. Mar. 2010;20:433–41.
Cheng J, Huang W, Cao S, Yang R, Yang W, Yun Z, et al. Enhanced performance of brain tumor classification via tumor region augmentation and partition. PloS ONE. Oct. 2015;10(10):Art no e0140381.
Ertosun MG, Rubin DL. “Automated grading of gliomas using deep learning in digital pathology images: a modular approach with ensemble of convolutional neural networks”, in Proc. AMIA Annu Symp Proc. Nov. 2015;2015:1899–908.
P. Afshar, K. N. Plataniotis, and A. Mohammadi. Capsule networks for brain tumor classification based on MRI images and course tumor boundaries, 2018, arXiv:1811.00597. [Online]. Available: https://arxiv.org/abs/1811.00597
Paul JS, Plassard AJ, Landman BA, Fabbri D. Deep learning for brain tumor classification. Proc. SPIE Med Imag, Biomed Appl Mol, Struct, Funct Imag, vol. 10137, Mar. 2017. Art. no. 1013710. https://doi.org/10.1117/12.2254195.
Anaraki AK, Ayati M, Kazemi F. Magnetic resonance imaging based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms. Biocybernetics Biomed Eng. Mar. 2019;39(1):63–74.
Hasan AM, Meziane F. Automated screening of MRI brain scanning using grey level statistics. Comput. Elect. Eng. Jul. 2016;53:276–91.
Nabizadeh N, Kubat M. Brain tumors detection and segmentation in MR images: Gabor wavelet vs. statistical features. J Comput Elect Eng. Jul. 2015;45:286–301.
Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja CK. A package-SFERCB-`segmentation, feature extraction, reduction and classification analysis by both SVM and ANN for brain tumors. Appl Soft Comput. Oct. 2016;47:151–67.
Lundervold AS, Lundervold A. An overview of deep learning in medical imaging focusing on MR. Z Med Phys. 2019;29(2):102–27.
Sin AI, Direkoslu C, Sah M. Review of MRI-based brain tumor image segmentation using deep learning methods. Procedia Comput Sci. 2016;102(2016):317–24. https://doi.org/10.1016/j.procs.2016.09.407.
Chen Y, Jiang H, Li C, Jia X, Ghamisi P. Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans Geosci Remote Sens. Oct. 2016;54(10):6232–51.
van der Burgh HK, Schmidt R, Westeneng H-J, de Reus MA, van den Berg LH, van den Heuvel MP. Deep learning predictions of survival based on MRI in amyotrophic lateral sclerosis. NeuroImage Clin. Oct. 2017;13:361–9. https://doi.org/10.1016/j.nicl.2016.10.008.
B. Wicht. Deep learning feature extraction for image processing, Ph.D. dissertation, Dept. Inform., Univ. Fribourg, Fribourg, Switzerland, 2017.
Ari A, Hanbay D. Deep learning based brain tumor classification and detection system. Turkish J Elect Eng Comput Sci. 2018;26(5):2275–86.
Huang M, Yang W, Yu M, Lu Z, Feng Q, Chen W. Retrieval of brain tumors with region-specific bag-of-visual-words representations in contrast-enhanced MRI images. Computational and mathematical methods in medicine, vol. 2012;2012.
Yang W, Feng Q, Yu M, Lu Z, Gao Y, Xu Y, et al. Content-based retrieval of brain tumor in contrast-enhanced MRI images using tumor margin information and learned distance metric. Med Phys. 2012;39:6929–42.
Huang M, Yang W, Wu Y, Jiang J, Gao Y, Chen Y, et al. Content-based image retrieval using spatial layout information in brain tumor T1-weighted contrast-enhanced MR images. PLoS One. 2014;9:e102754.
Cheng J, Yang W, Huang M, Huang W, Jiang J, Zhou Y, et al. Retrieval of brain tumors by adaptive spatial pooling and fisher vector representation. PLoS One. 2016;11:e0157112.
Greenspan H, Pinhas AT. Medical image categorization and retrieval for PACS using the GMM-KL framework. IEEE Trans Inf Technol Biomed. 2007;11:190–202.
Rahman MM, Desai BC, Bhattacharya P. Medical image retrieval with probabilistic multi-class support vector machine classifiers and adaptive similarity fusion. Comput Med Imaging Graph. 2008;32:95–108.
Iakovidis DK, Pelekis N, Kotsifakos EE, Kopanakis I, Karanikas H, Theodoridis Y. A pattern similarity scheme for medical image retrieval. IEEE Trans Inf Technol Biomed. 2009;13:442–50.
Jiang J, Wu Y, Huang M, Yang W, Chen W, Feng Q. 3D brain tumor segmentation in multimodal MR images based on learning population-and patient-specific feature sets. Comput Med Imaging Graph. 2013;37:512–21.
Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," nature, vol. 521, p. 436, 2015.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in neural information processing systems, 2012, pp. 1097–1105.
K. Simonyan and A. Zisserman, "very deep convolutional networks for large-scale image recognition," arXiv preprint arXiv:14091556, 2014.
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. Imagenet large scale visual recognition challenge. Int J Comput Vis. 2015;115:211–52.
Xiao T, Liu L, Li K, Qin W, Yu S, Li Z. Comparison of transferred deep neural networks in ultrasonic breast masses discrimination. BioMed Research International, vol. 2018;2018.
A. Sharif Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, “CNN features off-the-shelf: an astounding baseline for recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2014, pp. 806–813.
L. D. Nguyen, D. Lin, Z. Lin, and J. Cao, “Deep CNNs for microscopic image classification by exploiting transfer learning and feature concatenation,” Circuits and Systems (ISCAS), 2018 IEEE International Symposium on, 2018, pp. 1–5.
Khatami A, Babaie M, Tizhoosh HR, Khosravi A, Nguyen T, Nahavandi S. A sequential search-space shrinking using CNN transfer learning and a radon projection pool for medical image retrieval. Expert Syst Appl. 2018;100:224–33.
Wang G, Li W, Zuluaga MA, Pratt R, Patel PA, Aertsen M, et al. Interactive medical image segmentation using deep learning with image-specific fine-tuning: IEEE Transactions on Medical Imaging; 2018.
Swati ZNK, Zhao Q, Kabir M, Ali F, Zakir A, Ahmad S, et al. “Content-based brain tumor retrieval for MR images using transfer learning”, IEEE journals & magazines. Vol. 2019;7.
Nyúl LG, Udupa JK, Zhang X. New variants of a method of MRI scale standardization. IEEE Trans Med Imag. Feb. 2000;19(2):143–50.
L. Bottou, Large-scale machine learning with stochastic gradient descent, Proc. COMPSTAT. Physica-Verlag HD, 2010, pp. 177–186.
Goodfellow I, Bengio Y, Courville A. Deep learning. Cambridge, MA, USA: MIT press; 2016.
R. Colen, et al., “Imaging genomic mapping of an invasive MRI phenotype predicts patient outcome and metabolic dysfunction: a TCGA glioma phenotype research group project,” BMC Medical Genomics. vol. 7, no. 30, June 2014.
Velazquez ER, et al. Fully automatic GBM segmentation in the TCGA-GBM dataset: prognosis and correlation with VASARI features. Nat Sci Rep. Nov. 2015;5:16822.
Kumar R, Gupta A, Arora HS, Pandian GN, Raman B. CGHF: a computational decision support system for Glioma classification using hybrid Radiomics- and stationary wavelet-based features. IEEE Access. April 2020;8:79440–58.
Chang H, Zhong C, Han J, Mao JH. Unsupervised transfer learning via multi-scale convolutional sparse coding for biomedical applications. IEEE Trans Pattern Anal Mach Intell. May 2018;40(5):1182–94.
Nie D, et al. Estimating CT image from MRI data using 3D. International Workshop on Deep Learning in Medical Image Analysis, DLMIA. Sep. 2016;2016:170–8.
M. I. Razzak, M. Imran, G. Xu, “Efficient Brain Tumor Segmentation with Multiscale Two-Pathway-Group Conventional Neural Networks”, Journal of Latex Class Files, vol. 6, no. 1, January 2007.
A. M. Hasan, H. A. Jalab, F. Meziane, H. Kahtan, and A. S. Al-Ahmad, “Combining Deep and Handcrafted Image Features for MRI Brain Scan Classification”, IEEE Access, vol. 7, 2019.
Zhang L, Fried DV, Fave XJ, Hunter LA, Yang J, Court LE. An open infrastructure software platform to facilitate collaborative work in radiomics. Med Phys. March 2015;42(2):1341–53.
N. Nabizadeh, “Automated brain lesion detection and segmentation using magnetic resonance images,” Ph.D. dissertation, Dept. Elect. Comput. Eng., Univ. Miami, Coral Gables, FL, USA, 2015.