Artificial intelligence performance in detecting tumor metastasis from medical radiology imaging: A systematic review and meta-analysis

Yamashita, 2016, Lymph node ratio as a novel and simple prognostic factor in advanced gastric cancer, Eur J Surg Oncol, 42, 1253, 10.1016/j.ejso.2016.03.001 O'Sullivan, 2017, The TNM classification of malignant tumours-towards common understanding and reasonable expectations, Lancet Oncol, 18, 849, 10.1016/S1470-2045(17)30438-2 Ruytenberg, 2018, Improvements in high resolution laryngeal magnetic resonance imaging for preoperative transoral laser microsurgery and radiotherapy considerations in early lesions, Front Oncol, 8, 216, 10.3389/fonc.2018.00216 Tsili, 2020, Imaging of colorectal cancer liver metastases using contrast-enhanced US, multidetector CT, MRI, and FDG PET/CT: a meta-analysis, Acta Radiol Zhen, 2019, Accuracy of multiparametric magnetic resonance imaging for diagnosing prostate Cancer: a systematic review and meta-analysis, BMC Cancer, 19, 1244, 10.1186/s12885-019-6434-2 Ozturk, 2020, The diagnostic value of ultrasound and shear wave elastography in the differentiation of benign and malignant soft tissue tumors, Skeletal Radiol, 10.1007/s00256-020-03492-y Zhang, 2018, Big data and medical research in China, BMJ, 360, j5910, 10.1136/bmj.j5910 King, 2018, Artificial intelligence and radiology: what will the future hold?, J Am Coll Radiol, 15, 501, 10.1016/j.jacr.2017.11.017 Schlemmer, 2018, Global challenges for cancer imaging, J Glob Oncol, 4 Fukushima, 1980, Neocognitron: a self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, Biol Cybern, 36, 193, 10.1007/BF00344251 Cortes, 1995, Support-vector networks, Mach Learn, 20, 273, 10.1007/BF00994018 The random subspace method for constructing decision forests -IEEE J Magazine [Internet]. [cited 2018 Jul 10]. Availablefrom: https://ieeexplore.ieee.org/document/709601/. Hinton, 2006, A fast learning algorithm for deep belief nets, Neural Comput, 18, 1527, 10.1162/neco.2006.18.7.1527 Hinton, 2006, Reducing the dimensionality of data with neural networks, Science, 313, 504, 10.1126/science.1127647 Krizhevsky, 2012, Ainips. ImageNet classification with deep convolutional, Neural Netw, 25 Litjens, 2017, A survey on deep learning in medical image analysis, Med Image Anal, 42, 60, 10.1016/j.media.2017.07.005 Rajkomar, 2017, High-throughput classification of radiographs using deep convolutional neural networks, J Digit Imaging, 30, 10.1007/s10278-016-9914-9 Vamathevan, 2019, Applications of machine learning in drug discovery and development, Nat Rev Drug Discov, 18, 463, 10.1038/s41573-019-0024-5 Vinyals, 2017, Show and tell: lessons learned from the 2015 MSCOCO image captioning challenge, IEEE Trans Pattern Anal Mach Intell, 39, 652, 10.1109/TPAMI.2016.2587640 Cao, 2018, Deep learning and its applications in biomedicine, Geno Proteomics Bioinform, 16, 17, 10.1016/j.gpb.2017.07.003 Anthimopoulos, 2016, Lung pattern classification for interstitial lung diseases using a deep convolutional neural network, IEEE Trans Med Imaging, 35, 1207, 10.1109/TMI.2016.2535865 Xu, 2019, Deep learning predicts lung cancer treatment response from serial medical imaging, Clin Cancer Res, 25, 3266, 10.1158/1078-0432.CCR-18-2495 Kooi, 2017, Large scale deep learning for computer aided detection of mammographic lesions, Med Image Anal, 35, 303, 10.1016/j.media.2016.07.007 Yang, 2017, Quicksilver: fast predictive image registration - a deep learning approach, Neuroimage, 158, 378, 10.1016/j.neuroimage.2017.07.008 Hosny, 2018, Artificial intelligence in radiology, Nat Rev Cancer, 18, 500, 10.1038/s41568-018-0016-5 Ensmenger, 2012, Is chess the drosophila of artificial intelligence? A social history of an algorithm, Soc Stud Sci, 42, 5, 10.1177/0306312711424596 Moher, 2009, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement, BMJ, 339, b2535, 10.1136/bmj.b2535 Moons, 2014, Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist, PLoS Med, 11, 10.1371/journal.pmed.1001744 Whiting, 2011, QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies, Ann Intern Med, 155, 529, 10.7326/0003-4819-155-8-201110180-00009 Liu, 2019, A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis, Lancet Digit Health, 1, E271, 10.1016/S2589-7500(19)30123-2 Miller, 1994, Medical diagnostic decision support systems–past, present, and future: a threaded bibliography and brief commentary, J Am Med Inform Ass, 1, 8, 10.1136/jamia.1994.95236141 Liu, 2018, Comparison of the application of B-mode and strain elastography ultrasound in the estimation of lymph node metastasis of papillary thyroid carcinoma based on a radiomics approach, Int J Comput Assist Radiol Surg, 13, 1617, 10.1007/s11548-018-1796-5 Ozden, 2018, A comparison of logistic regression and artificial neural networks in predicting central lymph node metastases in papillary thyroid microcarcinoma, Ann Ital Chir, 89, 193 Nowikiewicz, 2017, Application of artificial neural networks for predicting presence of non-sentinel lymph node metastases in breast cancer patients with positive sentinel lymph node biopsies, Arch Med Sci, 13, 1399, 10.5114/aoms.2016.57677 Qiu, 2019, Factors associated with de novo metastatic disease in invasive breast cancer: comparison of artificial neural network and logistic regression models, 2019, 8, 77 Vaquero-Garcia, 2017, PRiMeUM: a model for predicting risk of metastasis in uveal melanoma, Invest Ophthalmol Vis Sci, 58, 4096, 10.1167/iovs.17-22255 Lin, 2019, Fast ScanNet: fast and dense analysis of multi-gigapixel whole-slide images for cancer metastasis detection, IEEE Trans Med Imaging, 38, 1948, 10.1109/TMI.2019.2891305 Bhooshan, 2010, Cancerous breast lesions on dynamic contrast-enhanced MR images: computerized characterization for image-based prognostic markers, Radiology, 254, 680, 10.1148/radiol.09090838 Altman, 2000, What do we mean by validating a prognostic model, Stat Med, 19, 453, 10.1002/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5 Koizumi, 2020, Diagnostic performance of a computer-assisted diagnostic system: sensitivity of BONENAVI for bone scintigraphy in patients with disseminated skeletal metastasis is not so high, Ann Nucl Med, 10.1007/s12149-020-01435-0 Li, 2020, Dual-energy CT-based deep learning radiomics can improve lymph node metastasis risk prediction for gastric cancer, Eur Radiol Zhang, 2020, Comparison of CT and MRI images for the prediction of soft-tissue sarcoma grading and lung metastasis via a convolutional neural networks model, Clin Radiol, 75, 64, 10.1016/j.crad.2019.08.008 Zhou, 2020, Lymph node metastasis prediction from primary breast cancer US images using deep learning, Radiology, 294, 19, 10.1148/radiol.2019190372 Grovik, 2020, Deep learning enables automatic detection and segmentation of brain metastases on multisequence MRI, J Magnetic Resonance Img, 51, 175, 10.1002/jmri.26766 Zhao, 2019, Deep neural network for automatic characterization of lesions on 68Ga-PSMA PET/CT Images, 2019, 951 Xue, 2019, Deep-learning-based detection and segmentation-assisted management on brain metastases, Neuro-oncology Baessler, 2019, Radiomics allows for detection of benign and malignant histopathology in patients with metastatic testicular germ cell tumors prior to post-chemotherapy retroperitoneal lymph node dissection, Eur Radiol Yang, 2019, Deep learning signature based on staging ct for preoperative prediction of sentinel lymph node metastasis in breast cancer, Acad Radiol Gao, 2019, Deep neural network-assisted computed tomography diagnosis of metastatic lymph nodes from gastric cancer, Chin Med J, 132, 2804, 10.1097/CM9.0000000000000532 Coronado-Gutierrez, 2019, Quantitative ultrasound image analysis of axillary lymph nodes to diagnose metastatic involvement in breast cancer, Ultrasound Med Biol, 45, 2932, 10.1016/j.ultrasmedbio.2019.07.413 Okada, 2019, Comparison of diagnostic precision for bone metastasis of primary breast cancer between BONENAVI version 1 and BONENAVI version 2, Nucl Med Commun, 40, 1148, 10.1097/MNM.0000000000001081 Lee, 2019, Application of deep learning to the diagnosis of cervical lymph node metastasis from thyroid cancer with CT, Eur Radiol, 29, 5452, 10.1007/s00330-019-06098-8 Jansen, 2019, Liver segmentation and metastases detection in MR images using convolutional neural networks, J Med Img (Bellingham, Wash), 6 Liu, 2019, Radiomics analysis of dynamic contrast-enhanced magnetic resonance imaging for the prediction of sentinel lymph node metastasis in breast cancer, Front Oncol, 9 Dohopolski, 2019, Predicting lymph node metastasis in patients with oropharyngeal cancer by convolutional neural networks with associated epistemic uncertainty, Int J Radiation Oncol Biol Phys, 105S, S122, 10.1016/j.ijrobp.2019.06.094 Peng, 2019, Deep multi-modality collaborative learning for distant metastases predication in PET-CT soft-tissue sarcoma studies, 2019, 3658 Feng, 2019, An intelligent clinical decision support system for preoperative prediction of lymph node metastasis in gastric cancer, J Am College Radiol, 16, 952, 10.1016/j.jacr.2018.12.017 Schnelldorfer, 2019, Can we accurately identify peritoneal metastases based on their appearance? an assessment of the current practice of intraoperative gastrointestinal cancer staging, Ann Surg Oncol, 26, 1795, 10.1245/s10434-019-07292-0 Mehta, 2019, Random forest classifiers aid in the detection of incidental osteoblastic osseous metastases in DEXA studies, Int J Comput Assist Radiol Surg, 14, 903, 10.1007/s11548-019-01933-1 Ariji, 2019, Contrast-enhanced computed tomography image assessment of cervical lymph node metastasis in patients with oral cancer by using a deep learning system of artificial intelligence, Oral Surg Oral Med Oral Pathol Oral Radiol, 127, 458, 10.1016/j.oooo.2018.10.002 Zhou, 2019, High definition MRI rectal lymph node aided diagnostic system based on deep neural network, Zhonghua Wai Ke Za Zhi, 57, 108 Li, 2019, Establishment of a new non-invasive imaging prediction model for liver metastasis in colon cancer, Am J Cancer Res, 9, 2482 Zhiguo Z, Dohopolski M, Liyuan C, et al. Reliable lymph node metastasis prediction in head & neck cancer through automated multi-objective model. 2019: 4. Acar, 2019, Machine learning for differentiating metastatic and completely responded sclerotic bone lesion in prostate cancer: a retrospective radiomics study, Br J Radiol, 92 Hou, 2019, OCT Automatic identification of metastatic lymph nodes in OCT images Ariji YA-OH, Sugita Y, Nagao T, et al. CT evaluation of extranodal extension of cervical lymph node metastases in patients with oral squamous cell carcinoma using deep learning classification. doi:10.1007/s11282-019-00391-4. Xu X, Li H, Wang S, et al. Multiplanar MRI-Based predictive model for preoperative assessment of lymph node metastasis in endometrial cancer. Luo, 2018, Bag of deep features for preoperative prediction of sentinel lymph node metastasis in breast cancer, Phys Med Biol, 63 Ha, 2018, Axillary lymph node evaluation utilizing convolutional neural networks using MRI dataset, J Digit Imaging, 31, 851, 10.1007/s10278-018-0086-7 Kann, 2018, Successful identification of head and neck cancer (HNC) nodal metastasis (NM) and extranodal extension (ENE) using deep learning neural networks, Int J Radiation Oncol Biol Phys, 102S, S60, 10.1016/j.ijrobp.2018.06.169 Lee, 2018, Deep learning-based computer-aided diagnosis system for localization and diagnosis of metastatic lymph nodes on ultrasound: a pilot study, THYROID, 28, 1332, 10.1089/thy.2018.0082 Lu, 2018, Identification of metastatic lymph nodes in MR imaging with faster region-based convolutional neural networks, Cancer Res., 78, 5135, 10.1158/0008-5472.CAN-18-0494 Ferreira Junior, 2018, Radiomics-based features for pattern recognition of lung cancer histopathology and metastases, Comput Methods Programs Biomed, 159, 23, 10.1016/j.cmpb.2018.02.015 Lo T-Y, Wei P-Y, Yen C-H, et al. Prediction of metastasis in head and neck cancer from computed tomography images. 2018: 18–23. Jin L, Peng W, Yanzhao L, Yang Z, Xiaolong L, Kuan L. Transfer learning of pre- trained inception-v3 model for colorectal cancer lymph node metastasis classification. 2018: 1650–4. Larhmam MA, Mahmoudi S, Drisis S, Benjelloun M. A Texture analysis approach for spine metastasis classification in T1 and T2 MRI. In: Rojas I, Ortuno F, editors; 2018: 198–211. Zhong Y, Yuan M, Zhang T, Zhang YD, Li H, Yu TF. Radiomics approach to prediction of occult mediastinal lymph node metastasis of lung adenocarcinoma. Wang, 2017, Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18F-FDG PET/CT images, EJNMMI Res, 7, 11, 10.1186/s13550-017-0260-9 Koizumi, 2017, Diagnostic performance of a computer-assisted diagnosis system for bone scintigraphy of newly developed skeletal metastasis in prostate cancer patients: search for low-sensitivity subgroups, Ann Nucl Med, 31, 521, 10.1007/s12149-017-1175-2 Wang, 2017, A multi-resolution approach for spinal metastasis detection using deep Siamese neural networks, Comput. Biol. Med., 84, 137, 10.1016/j.compbiomed.2017.03.024 Wang, 2017, Support vector machines model of computed tomography for assessing lymph node metastasis in esophageal cancer with neoadjuvant chemotherapy, J Comput Assist Tomogr, 41, 455, 10.1097/RCT.0000000000000555 Pham, 2017, Texture analysis and synthesis of malignant and benign mediastinal lymph nodes in patients with lung cancer on computed tomography, Sci Rep, 7 Zhang Q, Suo J, Chang W, Shi J, Chen M. Dual-modal computer-assisted evaluation of axillary lymph node metastasis in breast cancer patients on both real-time elastography and B-mode ultrasound. Wang, 2016, Can parameters other than minimal axial diameter in mri and pet/ct further improve diagnostic accuracy for equivocal retropharyngeal lymph nodes in nasopharyngeal carcinoma, PLoS ONE, 11 Aslantas A, Dandil E, Saglam S, Cakiroglu M. CADBOSS: a computer-aided diagnosis system for whole-body bone scintigraphy scans. Chmielewski, 2015, A computerized system to assess axillary lymph node malignancy from sonographic images, Ultrasound Med Biol, 41, 2690, 10.1016/j.ultrasmedbio.2015.05.022 Koizumi, 2015, Evaluation of a revised version of computer-assisted diagnosis system, BONENAVI version 2.1.7, for bone scintigraphy in cancer patients, Ann Nucl Med, 29, 659, 10.1007/s12149-015-0988-0 Koizumi, 2015, Evaluation of a computer-assisted diagnosis system, BONENAVI version 2, for bone scintigraphy in cancer patients in a routine clinical setting, Ann Nucl Med, 29, 138, 10.1007/s12149-014-0921-y Trabelsi N, Ben Sellem D. Comparison of supervised and unsupervised classifications in the detection of hepatic metastases. 2015. Gao X, Chu C, Li Y, et al. The method and efficacy of support vector machine classifiers based on texture features and multi-resolution histogram from (18)F-FDG PET-CT images for the evaluation of mediastinal lymph nodes in patients with lung cancer. Tokuda, 2014, Investigation of computer-aided diagnosis system for bone scans: a retrospective analysis in 406 patients, Ann Nucl Med, 28, 329, 10.1007/s12149-014-0819-8 Seff, 2014, 2D view aggregation for lymph node detection using a shallow hierarchy of linear classifiers, 544, 10.1007/978-3-319-10404-1_68 Zhou, 2013, An evidential reasoning based model for diagnosis of lymph node metastasis in gastric cancer, BMC Med Inform Decis Mak, 13 Yang, 2013, Computer-aided detection of metastatic brain tumors using magnetic resonance black-blood imaging, Invest Radiol, 48, 113, 10.1097/RLI.0b013e318277f078 Liu, 2013, A Variational framework for joint detection and segmentation of ovarian cancer metastases, 83, 10.1007/978-3-642-40763-5_11 Nakamura, 2013, Automatic abdominal lymph node detection method based on local intensity structure analysis from 3D X-ray CT images, 10.1117/12.2008282 Chang, 2013, Integrating PSONN and Boltzmann function for feature selection and classification of lymph nodes in ultrasound images, J Vis Commun Image Represent, 24, 23, 10.1016/j.jvcir.2012.10.004 Feulner J, Zhou Sk Fau Hammon M, Hammon M, Fau Hornegger J, Hornegger J, Fau Comaniciu D, Comaniciu D. Lymph node detection and segmentation in chest CT data using discriminative learning and a spatial prior. Li, 2012, Using the K-nearest neighbor algorithm for the classification of lymph node metastasis in gastric cancer, Comput Math Methods Med Cai H, Cui C Fau Tian H, Tian H Fau Zhang M, Zhang M Fau Li L, Li L. A novel approach to segment and classify regional lymph nodes on computed tomography images. Chen SJ, Lin Ch Fau Chang C-Y, Chang Cy Fau Chang K-Y, et al. Characterizing the major sonographic textural difference between metastatic and common benign lymph nodes using support vector machine with histopathologic correlation. Zhang, 2011, Support vector machine model for diagnosis of lymph node metastasis in gastric cancer with multidetector computed tomography: a preliminary study, BMC Cancer, 11 Dietzel, 2010, Application of artificial neural networks for the prediction of lymph node metastases to the ipsilateral axilla - initial experience in 194 patients using magnetic resonance mammography, Acta radiol, 51, 851, 10.3109/02841851.2010.498444 Sadik, 2008, Computer-assisted interpretation of planar whole-body bone scans, J Nuclear Med, 49, 1958, 10.2967/jnumed.108.055061 Shiraishi, 2008, Computer-aided diagnosis for the classification of focal liver lesions by use of contrast-enhanced ultrasonography, Med Phys, 35, 1734, 10.1118/1.2900109 Zhang, 2008, Computer-aided diagnosis of cervical lymph nodes on ultrasonography, Comput. Biol. Med., 38, 234, 10.1016/j.compbiomed.2007.10.005 Tagaya, 2008, Automatic objective diagnosis of lymph nodal disease by B-mode images from convex-type echobronchoscopy, Chest, 133, 137, 10.1378/chest.07-1497 Marten K, Grillhosl A, Fau Seyfarth T, Seyfarth T, Fau Obenauer S, Obenauer S, Fau Rummeny EJ, Rummeny Ej Fau Engelke C, Engelke C. Computer-assisted detection of pulmonary nodules: evaluation of diagnostic performance using an expert knowledge-based detection system with variable reconstruction slice thickness settings.