Adaptive deep learning for head and neck cancer detection using hyperspectral imaging

Visual Computing for Industry, Biomedicine, and Art - Tập 2 Số 1 - 2019
Ling Ma1, Guolan Lu1, Dongsheng Wang2, Xulei Qin1, Zhuo Georgia Chen2, Baowei Fei1
1Department of Radiology and Imaging Sciences, Emory University, Atlanta, GA, 30322, USA
2Department of Hematology and Medical Oncology, Emory University, Atlanta, GA 30322, USA

Tóm tắt

AbstractIt can be challenging to detect tumor margins during surgery for complete resection. The purpose of this work is to develop a novel learning method that learns the difference between the tumor and benign tissue adaptively for cancer detection on hyperspectral images in an animal model. Specifically, an auto-encoder network is trained based on the wavelength bands on hyperspectral images to extract the deep information to create a pixel-wise prediction of cancerous and benign pixel. According to the output hypothesis of each pixel, the misclassified pixels would be reclassified in the right prediction direction based on their adaptive weights. The auto-encoder network is again trained based on these updated pixels. The learner can adaptively improve the ability to identify the cancer and benign tissue by focusing on the misclassified pixels, and thus can improve the detection performance. The adaptive deep learning method highlighting the tumor region proved to be accurate in detecting the tumor boundary on hyperspectral images and achieved a sensitivity of 92.32% and a specificity of 91.31% in our animal experiments. This adaptive learning method on hyperspectral imaging has the potential to provide a noninvasive tool for tumor detection, especially, for the tumor whose margin is indistinct and irregular.

Từ khóa


Tài liệu tham khảo

Mehanna H, Beech T, Nicholson T, El-Hariry I, McConkey C, Paleri V et al (2013) Prevalence of human papillomavirus in oropharyngeal and nonoropharyngeal head and neck cancer-systematic review and meta-analysis of trends by time and region. Head Neck 35(5):747–755 https://doi.org/10.1002/hed.22015

Haddad RI, Shin DM (2008) Recent advances in head and neck cancer. N Engl J Med 359(11):1143–1154 https://doi.org/10.1056/NEJMra0707975

van den Brekel MWM, Lodder WL, Stel HV, Bloemena E, Leemans CR, van der Waal I (2012) Observer variation in the histopathologic assessment of extranodal tumor spread in lymph node metastases in the neck. Head Neck 34(6):840–845 https://doi.org/10.1002/hed.21823

Goetz AFH, Vane G, Solomon JE, Rock BN (1985) Imaging spectrometry for earth remote sensing. Science 228(4704):1147–1153 https://doi.org/10.1126/science.228.4704.1147

Calin MA, Parasca SV, Savastru D, Manea D (2013) Hyperspectral imaging in the medical field: present and future. Appl Spectrosc Rev 49(6):435–447 https://doi.org/10.1080/05704928.2013.838678

Lu GL, Fei BW (2014) Medical hyperspectral imaging: a review. J Biomed Opt 19(1):010901 https://doi.org/10.1117/1.JBO.19.1.010901

Borengasser M, Hungate WS, Watkins R (2007) Hyperspectral remote sensing: principles and applications. CRC Press, Boca Raton, FL, USA. DOI: https://doi.org/10.1201/9781420012606

Lazcano R, Madroñal D, Salvador R, Desnos K, Pelcat M, Guerra R et al (2017) Porting a PCA-based hyperspectral image dimensionality reduction algorithm for brain cancer detection on a manycore architecture. J Syst Arch 77:101–111 https://doi.org/10.1016/j.sysarc.2017.05.001

Chung H, Lu GL, Tian ZQ, Wang DS, Chen ZG, Fei BW (2016) Superpixel-based spectral classification for the detection of head and neck cancer with hyperspectral imaging. In: abstracts of SPIE 9788, medical imaging 2016: biomedical applications in molecular, structural, and functional imaging, SPIE, San Diego, CA, USA, 29 March 2016, p 978813 DOI: https://doi.org/10.1117/12.2216559

Lu GL, Halig LV, Wang DS, Qin XL, Chen ZG, Fei BW (2014) Spectral-spatial classification for noninvasive cancer detection using hyperspectral imaging. J Biomed Opt 19(10):106004 https://doi.org/10.1117/1.JBO.19.10.106004

Ravì D, Fabelo H, Callic GM, Yang GZ (2017) Manifold embedding and semantic segmentation for intraoperative guidance with hyperspectral brain imaging. IEEE Trans Med Imaging 36(9):1845–1857 https://doi.org/10.1109/TMI.2017.2695523

Fabelo H, Ortega S, Ravi D, Kiran BR, Sosa C, Bulters D et al (2018) Spatio-spectral classification of hyperspectral images for brain cancer detection during surgical operations. PLoS One 13(3):e0193721 https://doi.org/10.1371/journal.pone.0193721

Lu GL, Wang DS, Qin XL, Halig L, Muller S, Zhang HZ et al (2015) Framework for hyperspectral image processing and quantification for cancer detection during animal tumor surgery. J Biomed Opt 20(12):126012 https://doi.org/10.1117/1.JBO.20.12.126012

Siddiqi AM, Li H, Faruque F, Williams W, Lai K, Hughson M et al (2008) Use of hyperspectral imaging to distinguish normal, precancerous, and cancerous cells. Cancer 114(1):13–21 https://doi.org/10.1002/cncr.23286

Liu Z, Wang HJ, Li QL (2012) Tongue tumor detection in medical hyperspectral images. Sensors 12(1):162–174 https://doi.org/10.3390/s120100162

Regeling B, Laffers W, Gerstner AOH, Westermann S, Müller NA, Schmidt K et al (2016) Development of an image pre-processor for operational hyperspectral laryngeal cancer detection. J Biophotonics 9(3):235–245 https://doi.org/10.1002/jbio.201500151

Kho E, de Boer LL, Van de Vijver KK, Sterenborg HJCM, Ruers TJ (2018) Hyperspectral imaging for detection of breast cancer in resection margins using spectral-spatial classification. In: abstracts of SPIE 10472, diagnosis and treatment of diseases in the breast and reproductive system IV, SPIE, San Francisco, CA, USA, 14 March 2018, p 104720F DOI: https://doi.org/10.1117/12.2288367

Gopi A, Reshmi CS, Aneesh RP (2017) An effective segmentation algorithm for the hyperspectral cancer images. In: abstracts of 2017 international conference on networks & advances in computational technologies, IEEE, Thiruvanthapuram, India, 20 July 2017, pp 294-299 DOI: https://doi.org/10.1109/NETACT.2017.8076783

Zarei N, Bakhtiari A, Gallagher P, Keys M, MacAulay C (2017) Automated prostate glandular and nuclei detection using hyperspectral imaging. In: abstracts of the IEEE 14th international symposium on biomedical imaging, IEEE, Melbourne, VIC, Australia, 18 April 2017, pp 1028-1031 DOI: https://doi.org/10.1109/ISBI.2017.7950691

Fei BW, Lu GL, Halicek MT, Wang X, Zhang HZ, Little JV, et al (2017) Label-free hyperspectral imaging and quantification methods for surgical margin assessment of tissue specimens of cancer patients. In: abstracts of the 39th annual international conference of the IEEE engineering in medicine and biology society, IEEE, Seogwipo, South Korea, 11 July 2017, pp 4041-4045 DOI: https://doi.org/10.1109/EMBC.2017.8037743

Lu GL, Little JV, Wang X, Zhang HZ, Patel MR, Griffith CC et al (2017) Detection of head and neck cancer in surgical specimens using quantitative hyperspectral imaging. Clin Cancer Res 23(18):5426–5436 https://doi.org/10.1158/1078-0432.CCR-17-0906

Lu GL, Qin XL, Wang DS, Muller S, Zhang HZ, Chen A, et al (2016) Hyperspectral imaging of neoplastic progression in a mouse model of oral carcinogenesis. In: abstracts of SPIE 9788, medical imaging 2016: biomedical applications in molecular, structural, and functional imaging, SPIE, San Diego, CA, USA, 29 March 2016, p 978812 DOI: https://doi.org/10.1117/12.2216553

Fei BW, Lu GL, Wang X, Zhang HZ, Little JV, Patel MR et al (2017) Label-free reflectance hyperspectral imaging for tumor margin assessment: a pilot study on surgical specimens of cancer patients. J Biomed Opt 22(8):086009 https://doi.org/10.1117/1.JBO.22.8.086009

Beaulieu RJ, Goldstein SD, Singh J, Safar B, Banerjee A, Ahuja N (2018) Automated diagnosis of colon cancer using hyperspectral sensing. Int J Med Robot Comput Assist Surg 14(3):e1897 https://doi.org/10.1002/rcs.1897

de Koning SG, Karakullukcu MB, Smit L, Baltussen EJM, Sterenborg HJCM, Ruers TJM (2018) Near infrared hyperspectral imaging to evaluate tongue tumor resection margins intraoperatively. In: abstracts of SPIE 10469, optical imaging, therapeutics, and advanced technology in head and neck surgery and otolaryngology 2018, SPIE, San Francisco, CA, USA, 14 March 2018, p 104690G

Yuan X, Zhang D, Wang C, Dai B, Zhao M, Li B (2018) Hyperspectral imaging and SPA-LDA quantitative analysis for detection of colon cancer tissue. J Appl Spectrosc 85(2):307–312 https://doi.org/10.1007/s10812-018-0649-x

Akbari H, Halig L, Schuster DM, Fei BW, Osunkoya A, Master V et al (2012) Hyperspectral imaging and quantitative analysis for prostate cancer detection. J Biomed Opt 17(7):076005 https://doi.org/10.1117/1.JBO.17.7.076005

Lu GL, Wang DS, Qin XL, Muller SS, Wang X, Chen AY et al (2018) Detection and delineation of squamous neoplasia with hyperspectral imaging in a mouse model of tongue carcinogenesis. J Biophotonics 11(3):e201700078 https://doi.org/10.1002/jbio.201700078

Akbari H, Uto K, Kosugi Y, Kojima K, Tanaka N (2011) Cancer detection using infrared hyperspectral imaging. Cancer Sci 102(4):852–857 https://doi.org/10.1111/j.1349-7006.2011.01849.x

Akbari H, Halig LV, Zhang HZ, Wang DS, Chen ZG, Fei BW (2012) Detection of cancer metastasis using a novel macroscopic hyperspectral method. In: abstracts of SPIE 8317, medical imaging 2012: biomedical applications in molecular, structural, and functional imaging, SPIE, San Diego, CA, USA, 14 April 2012, p 831711 DOI: https://doi.org/10.1117/12.912026

Pike R, Lu GL, Wang DS, Chen ZG, Fei BW (2016) A minimum spanning forest-based method for noninvasive cancer detection with hyperspectral imaging. IEEE Trans Biomed Eng 63(3):653–663 https://doi.org/10.1109/TBME.2015.2468578

Torti E, Fontanella A, Florimbi G, Leporati F, Fabelo H, Ortega S et al (2018) Acceleration of brain cancer detection algorithms during surgery procedures using GPUs. Microprocess Microsyst 61:171–178 https://doi.org/10.1016/j.micpro.2018.06.005

Nathan M, Kabatznik AS, Mahmood A (2018) Hyperspectral imaging for cancer detection and classification. In: abstracts of the 3rd biennial south African biomedical engineering conference, IEEE, Stellenbosch, South Africa, 4 April 2018, pp 1-4 DOI: https://doi.org/10.1109/SAIBMEC.2018.8363180

Ortega S, Fabelo H, Camacho R, Plaza ML, Callico GM, Lazcano R et al (2017) P03.18 detection of human brain cancer in pathological slides using hyperspectral images. Neuro-Oncol 19(Suppl 3):iii37 https://doi.org/10.1093/neuonc/nox036.133

Ortega S, Callicó GM, Plaza ML, Camacho R, Fabelo H, Sarmiento R (2016) Hyperspectral database of pathological in-vitro human brain samples to detect carcinogenic tissues. In: abstracts of the IEEE 13th international symposium on biomedical imaging, IEEE, Prague, Czech Republic, 13 April 2016, pp 369-372 DOI: https://doi.org/10.1109/ISBI.2016.7493285

Calin MA, Parasca Sr SV, Manea D (2018) Comparison of spectral angle mapper and support vector machine classification methods for mapping skin burn using hyperspectral imaging. In: abstracts of SPIE 10677, unconventional optical imaging, SPIE, Strasbourg, France, 13 August 2018, p 106773P DOI: https://doi.org/10.1117/12.2319267

Ortega S, Fabelo H, Camacho R, De la Luz PM, Callicó GM, Sarmiento R (2018) Detecting brain tumor in pathological slides using hyperspectral imaging. Biomed Opt Express 9(2):818–831 https://doi.org/10.1364/BOE.9.000818

Florimbi G, Fabelo H, Torti E, Lazcano R, Madroñal D, Ortega S et al (2018) Accelerating the K-nearest neighbors filtering algorithm to optimize the real-time classification of human brain tumor in hyperspectral images. Sensors 18(7):2314 https://doi.org/10.3390/s18072314

Khouj Y, Dawson JM, Coad J, Vona-Davis L (2018) Hyperspectral imaging and K-means classification for histologic evaluation of ductal carcinoma in situ. Front Oncol 8:17 https://doi.org/10.3389/fonc.2018.00017

Lall M, Deal J, Hill S, Rider P, Boudreaux C, Rich T, Leavesley S (2017) Classification of normal and Lesional colon tissue using fluorescence excitation-scanning hyperspectral imaging as a method for early diagnosis of colon cancer. In: abstracts of the national conference on undergraduate research, University of Memphis, Memphis, TN, USA, 6-8 April 2017, pp 1063-1073

Regeling B, Thies B, Gerstner AOH, Westermann S, Müller NA, Bendix J et al (2016) Hyperspectral imaging using flexible endoscopy for laryngeal cancer detection. Sensors 16(8):1288 https://doi.org/10.3390/s16081288

LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444 https://doi.org/10.1038/nature14539

Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117 https://doi.org/10.1016/j.neunet.2014.09.003

Makantasis K, Karantzalos K, Doulamis A, Doulamis N. (2015) Deep supervised learning for hyperspectral data classification through convolutional neural networks. In: Abstracts of 2015 IEEE international geoscience and remote sensing symposium, IEEE, Milan, Italy, 26 July 2015, pp 4959–4962 DOI: https://doi.org/10.1109/IGARSS.2015.7326945

Halicek M, Little JV, Wang X, Chen AY, Fei BW (2019) Optical biopsy of head and neck cancer using hyperspectral imaging and convolutional neural networks. J Biomed Opt 24(3):036007 https://doi.org/10.1117/1.JBO.24.3.036007

Halicek M, Lu GL, Little JV, Wang X, Patel M, Griffith CC et al (2017) Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. J Biomed Opt 22(6):060503 https://doi.org/10.1117/1.JBO.22.6.060503

Halicek M, Little JV, Wang X, Patel M, Griffith CC, Chen AY, et al (2018) Tumor margin classification of head and neck cancer using hyperspectral imaging and convolutional neural networks. In: abstracts of SPIE 10576, medical imaging 2018: image-guided procedures, robotic interventions, and modeling, SPIE, Houston, TX, United States, 12 March 2018, p 1057605 DOI: https://doi.org/10.1117/12.2293167

Ma L, Lu GL, Wang DS, Wang X, Chen ZG, Muller S, et al (2017) Deep learning based classification for head and neck cancer detection with hyperspectral imaging in an animal model. In: abstracts of SPIE 10137, medical imaging 2017: biomedical applications in molecular, structural, and functional imaging, SPIE, Orlando, FL, USA, 13 March 2017, p 101372G DOI: https://doi.org/10.1117/12.2255562

Halicek M, Dormer JD, Little JV, Chen AY, Myers L, Sumer BD et al (2019) Hyperspectral imaging of head and neck squamous cell carcinoma for cancer margin detection in surgical specimens from 102 patients using deep learning. Cancers 11(9):1367 https://doi.org/10.3390/cancers11091367

Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: abstracts of 2015 IEEE conference on computer vision and pattern recognition, IEEE, Boston, MA, USA, 7-12 June 2015, pp 3431-3440 DOI: https://doi.org/10.1109/CVPR.2015.7298965

Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495 https://doi.org/10.1109/TPAMI.2016.2644615

Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: abstracts of the 18th international conference on medical image computing and computer-assisted intervention, Springer, Munich, Germany, 5-9 October 2015, pp 234-241 DOI: https://doi.org/10.1007/978-3-319-24574-4_28

Trajanovski S, Shan CF, Weijtmans PJC, de Koning, SGB, Ruers TJM (2019) Tumor semantic segmentation in hyperspectral images using deep learning. In: Abstracts Proceedings of the 2nd international conference on medical imaging with deep learning, MIDL, London, UK, 7 July 2019, pp 8–10

Kho E, Dashtbozorg B, de Boer LL, Van de Vijver KK, Sterenborg HJCM, Ruers TJM (2019) Broadband hyperspectral imaging for breast tumor detection using spectral and spatial information. Biomed Opt Express 10(9):4496–4515 https://doi.org/10.1364/BOE.10.004496

Lu GL, Halig L, Wang DS, Chen ZG, Fei BW (2014) Spectral-spatial classification using tensor modeling for cancer detection with hyperspectral imaging. In: abstracts of SPIE 9034, medical imaging 2014: image processing, SPIE, San Diego, CA, United States. 21 March 2014, p 903413 DOI: https://doi.org/10.1117/12.2043796

Hinton GE, Zemel RS (1993) Autoencoders, minimum description length and Helmholtz free energy. In: abstracts of the 6th international conference on neural information processing systems, Morgan Kaufmann publishers Inc., Denver, CO, USA, 2 December 1993, pp 3-10

Thông tin
Thông tin xuất bản

Visual Computing for Industry, Biomedicine, and Art

Tập 2 Số 1

Thông tin tác giả