The Liver Tumor Segmentation Benchmark (LiTS)

Abdel-massieh, 2010, Fully automatic liver tumor segmentation from abdominal CT scans, 197 Albain, 2009, Radiotherapy plus chemotherapy with or without surgical resection for stage III non-small-cell lung cancer: A phase III randomised controlled trial, Lancet, 374, 379, 10.1016/S0140-6736(09)60737-6 Amiranashvili, 2021, Learning shape reconstruction from sparse measurements with neural implicit functions Antonelli, 2022, The medical segmentation decathlon, Nature Commun., 13, 1, 10.1038/s41467-022-30695-9 Bauknecht, 2010, Intra-and interobserver variability of linear and volumetric measurements of brain metastases using contrast-enhanced magnetic resonance imaging, Invest. Radiol., 45, 49, 10.1097/RLI.0b013e3181c02ed5 Ben-Dan, 2008, Liver tumor segmentation in CT images using probabilistic methods, vol. 41, 43 Blachier, 2013, The burden of liver disease in Europe: A review of available epidemiological data, J. Hepatol., 58, 593, 10.1016/j.jhep.2012.12.005 Bornemann, 2007, Oncotreat: A software assistant for cancer therapy monitoring, Int. J. Comput. Assist. Radiol. Surg., 1, 231, 10.1007/s11548-006-0059-z Cano-Espinosa, 2020, Biomarker localization from deep learning regression networks, IEEE Trans. Med. Imaging, 39, 2121, 10.1109/TMI.2020.2965486 Castro, 2020, Causality matters in medical imaging, Nature Commun., 11, 1, 10.1038/s41467-020-17478-w Chlebus, 2018, Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing, Sci. Rep., 8, 1, 10.1038/s41598-018-33860-7 Christ, P., Elshaer, M.E.A., Ettlinger, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Armbruster, M., Hofmann, F., D’Anastasi, M., Sommer, W.H., Ahmadi, S.-A., Menze, B.H., 2016. Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016: 19th International Conference. pp. 415–423. Ciecholewski, 2007, Automatic segmentation of single and multiple neoplastic hepatic lesions in CT images, 63 Cleary, 2017 Conze, 2017, Scale-adaptive supervoxel-based random forests for liver tumor segmentation in dynamic contrast-enhanced CT scans, Int. J. Comput. Assist. Radiol. Surg., 12, 223, 10.1007/s11548-016-1493-1 Cootes, 1995, Active shape models-their training and application, Comput. Vis. Image Underst., 61, 38, 10.1006/cviu.1995.1004 Dawant, 2007, Semi-automatic segmentation of the liver and its evaluation on the MICCAI 2007 grand challenge data set, 3D Segm. Clin.: Grand Chall., 215 Deng, X., Du, G., 2008. 3D segmentation in the clinic: A grand challenge II-liver tumor segmentation. In: MICCAI Workshop. Dou, 2016, 3D deeply supervised network for automatic liver segmentation from ct volumes, 149 Eisenhauer, 2009, New response evaluation criteria in solid tumours: Revised RECIST guideline (version 1.1), Eur. J. Cancer, 45, 228, 10.1016/j.ejca.2008.10.026 Erickson, 2016, Radiology data from the cancer genome atlas liver hepatocellular carcinoma [TCGA-LIHC] collection, Cancer Imaging Arch. Fang, 2020, Multi-organ segmentation over partially labeled datasets with multi-scale feature abstraction, IEEE Trans. Med. Imaging, 39, 3619, 10.1109/TMI.2020.3001036 Glocker, 2019 Gobbi, 2004, The clinical value of tumor burden at diagnosis in Hodgkin lymphoma, Cancer: Interdiscipl. Int. J. Am. Cancer Soc., 101, 1824, 10.1002/cncr.20568 Haghighi, 2020, Learning semantics-enriched representation via self-discovery, self-classification, and self-restoration, 137 Haghighi, 2021, Transferable visual words: Exploiting the semantics of anatomical patterns for self-supervised learning, IEEE Trans. Med. Imaging, 10.1109/TMI.2021.3060634 Häme, 2008, Liver tumor segmentation using implicit surface evolution, Midas J., 1 Hann, 2000, Diagnostic imaging approaches and relationship to hepatobiliary cancer staging and therapy, vol. 19, 94 Heimann, 2007, A shape-guided deformable model with evolutionary algorithm initialization for 3D soft tissue segmentation, 1 Heimann, 2009, Comparison and evaluation of methods for liver segmentation from CT datasets, IEEE Trans. Med. Imaging, 28, 1251, 10.1109/TMI.2009.2013851 Heimann, 2006, Active shape models for a fully automated 3D segmentation of the liver–an evaluation on clinical data, 41 Heussel, 2007, Follow-up CT measurement of liver malignoma according to RECIST and WHO vs. volumetry, RoFo: Fortschr. Geb. Rontgenstr. Nuklearmed., 179, 958 Hu, 2016, Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution, Phys. Med. Biol., 61, 8676, 10.1088/1361-6560/61/24/8676 Huang, 2020, Multi-organ segmentation via co-training weight-averaged models from few-organ datasets, 146 Isensee, 2020, Nnu-Net: A self-configuring method for deep learning-based biomedical image segmentation, Nature Methods, 1 Jagannath, 1986, Tumor burden assessment and its implication for a prognostic model in advanced diffuse large-cell lymphoma, J. Clin. Oncol., 4, 859, 10.1200/JCO.1986.4.6.859 Jiménez Carretero, 2011 Kainmüller, D., Lange, T., Lamecker, H., 2007. Shape constrained automatic segmentation of the liver based on a heuristic intensity model. In: Proc. MICCAI Workshop 3D Segmentation in the Clinic: A Grand Challenge. pp. 109–116. Kass, 1988, Snakes: Active contour models, Int. J. Comput. Vis., 1, 321, 10.1007/BF00133570 Kavur, 2021, CHAOS challenge-combined (CT-MR) healthy abdominal organ segmentation, Med. Image Anal., 69, 10.1016/j.media.2020.101950 Kuang, 2022 Kuhnigk, 2006, Morphological segmentation and partial volume analysis for volumetry of solid pulmonary lesions in thoracic CT scans, IEEE Trans. Med. Imaging, 25, 417, 10.1109/TMI.2006.871547 Lamecker, 2004 Li, 2018, H-DenseUNet: Hybrid densely connected unet for liver and tumor segmentation from CT volumes, IEEE Trans. Med. Imaging, 37, 2663, 10.1109/TMI.2018.2845918 Li, 2006, A machine learning approach for locating boundaries of liver tumors in ct images, 400 Li, 2018, Fully convolutional network ensembles for white matter hyperintensities segmentation in MR images, NeuroImage, 183, 650, 10.1016/j.neuroimage.2018.07.005 Ling, 2008, Hierarchical, learning-based automatic liver segmentation, 1 Linguraru, 2012, Tumor burden analysis on computed tomography by automated liver and tumor segmentation, Med. Imaging, IEEE Trans., 31, 1965, 10.1109/TMI.2012.2211887 Litjens, 2017 Lu, 2017, Automatic 3D liver location and segmentation via convolutional neural network and graph cut, Int. J. Comput. Assist. Radiol. Surg., 12, 171, 10.1007/s11548-016-1467-3 Ma, 2021 Ma, 2020, Learning geodesic active contours for embedding object global information in segmentation cnns, IEEE Trans. Med. Imaging Maier-Hein, 2020, BIAS: Transparent reporting of biomedical image analysis challenges, Med. Image Anal., 66, 10.1016/j.media.2020.101796 Massoptier, 2007, Fully automatic liver segmentation through graph-cut technique, 5243 Massoptier, 2008, A new fully automatic and robust algorithm for fast segmentation of liver tissue and tumors from CT scans, Eur. Radiol.s, 18, 1658, 10.1007/s00330-008-0924-y McKnight, 2010, Mann-whitney u test, 1 Mehta, 2020 Milletari, 2016, V-net: Fully convolutional neural networks for volumetric medical image segmentation, 565 Moghbel, 2017, Review of liver segmentation and computer assisted detection/diagnosis methods in computed tomography, Artif. Intell. Rev., 1 Moltz, 2008, Segmentation of liver metastases in CT scans by adaptive thresholding and morphological processing, vol. 41, 195 Moltz, 2009, Advanced segmentation techniques for lung nodules, liver metastases, and enlarged lymph nodes in CT scans, IEEE J. Sel. Top. Sign. Proces., 3, 122, 10.1109/JSTSP.2008.2011107 Nordlinger, 1996, Surgical resection of colorectal carcinoma metastases to the liver: A prognostic scoring system to improve case selection, based on 1568 patients, Cancer: Interdiscipl. Int. J. Am. Cancer Soc., 77, 1254, 10.1002/(SICI)1097-0142(19960401)77:7<1254::AID-CNCR5>3.0.CO;2-I Nugroho, 2008, Contrast enhancement for liver tumor identification, vol. 41, 201 Osher, 1988, Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations, J. Comput. Phys., 79, 12, 10.1016/0021-9991(88)90002-2 Park, 2003, Construction of an abdominal probabilistic atlas and its application in segmentation, IEEE Trans. Med. Imaging, 22, 483, 10.1109/TMI.2003.809139 Pati, 2021 Puesken, 2010, Prediction of lymph node manifestations in malignant lymphoma: Significant role of volumetric compared with established metric lymph node analysis in multislice computed tomography, J. Comput. Assist. Tomogr., 34, 564, 10.1097/RCT.0b013e3181db2901 Rey, 2011, Wilcoxon-signed-rank test, 1658 Rieke, 2020, The future of digital health with federated learning, NPJ Digit. Med., 3, 1, 10.1038/s41746-020-00323-1 Ronneberger, O., Fischer, P., Brox, T., 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In: MICCAI, vol. 9351. pp. 234–241. Saddi, 2007, Global-to-local shape matching for liver segmentation in CT imaging, 207 Schoppe, 2020, Deep learning-enabled multi-organ segmentation in whole-body mouse scans, Nature Commun., 11, 1, 10.1038/s41467-020-19449-7 Sheller, 2020, Federated learning in medicine: Facilitating multi-institutional collaborations without sharing patient data, Sci. Rep., 10, 1, 10.1038/s41598-020-69250-1 Sheller, 2018, Multi-institutional deep learning modeling without sharing patient data: A feasibility study on brain tumor segmentation, 92 Shiina, 2018, Percutaneous ablation for hepatocellular carcinoma: Comparison of various ablation techniques and surgery, Canad. J. Gastroenterol. Hepatol., 2018 Shimizu, A., Narihira, T., Furukawa, D., Kobatake, H., Nawano, S., Shinozaki, K., 2008. Ensemble segmentation using AdaBoost with application to liver lesion extraction from a CT volume. In: Proc. MICCAI Workshop on 3D Segmentation in the Clinic: A Grand Challenge II. NY, USA. Shirokikh, 2020, Universal loss reweighting to balance lesion size inequality in 3D medical image segmentation, 523 Slagmolen, P., Elen, A., Seghers, D., Loeckx, D., Maes, F., Haustermans, K., 2007. Atlas based liver segmentation using nonrigid registration with a B-spline transformation model. In: Proceedings of MICCAI Workshop on 3D Segmentation in the Clinic: A Grand Challenge. pp. 197–206. Smeets, 2008, Segmentation of liver metastases using a level set method with spiral-scanning technique and supervised fuzzy pixel classification, vol. 42, 43 Soler, 2001, Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery, Comput. Aided Surg., 6, 131, 10.3109/10929080109145999 Soler, L., Hostettler, A., Agnus, V., Charnoz, A., Fasquel, J., Moreau, J., Osswald, A., Bouhadjar, M., Marescaux, J., 2010. 3D Image Reconstruction for Comparison of Algorithm Database: A Patient-Specific Anatomical and Medical Image Database. IRCAD, Strasbourg. Tech. Rep.. Stewart, 2014, World cancer report 2014, 630 Tang, 2020, E AÂNet: An edge enhanced network for accurate liver and tumor segmentation on CT scans, 512 Todorov, 2020, Machine learning analysis of whole mouse brain vasculature, Nature Methods, 17, 442, 10.1038/s41592-020-0792-1 Tomoshige, 2014, A conditional statistical shape model with integrated error estimation of the conditions; Application to liver segmentation in non-contrast CT images, Med. Image Anal., 18, 130, 10.1016/j.media.2013.10.003 Jimenez-del Toro, 2016, Cloud-based evaluation of anatomical structure segmentation and landmark detection algorithms: VISCERAL anatomy benchmarks, IEEE Trans. Med. Imaging, 35, 2459, 10.1109/TMI.2016.2578680 van Rikxoort, 2007, Automatic segmentation of the liver in computed tomography scans with voxel classification and atlas matching, 101 Virdis, 2019, Clinical outcomes of primary arterial embolization in severe hepatic trauma: A systematic review, Diagn. Interv. Imaging, 100, 65, 10.1016/j.diii.2018.10.004 Vorontsov, 2014, Metastatic liver tumor segmentation using texture-based omni-directional deformable surface models, 74 Wang, 2020, Conquering data variations in resolution: A slice-aware multi-branch decoder network, IEEE Trans. Med. Imaging, 39, 4174, 10.1109/TMI.2020.3014433 Wang, 2021, Pairwise learning for medical image segmentation, Med. Image Anal., 67, 10.1016/j.media.2020.101876 Wang, 2019, Volumetric attention for 3D medical image segmentation and detection, 175 Wang, 2015, Adaptive mesh expansion model (AMEM) for liver segmentation from CT image, PLoS One, 10 Wen, 2009, Comparison of AdaBoost and logistic regression for detecting colorectal cancer patients with synchronous liver metastasis, 1 Wiesenfarth, 2021, Methods and open-source toolkit for analyzing and visualizing challenge results, Sci. Rep., 11, 1 Wu, 2016, Automatic liver segmentation on volumetric CT images using supervoxel-based graph cuts, Comput. Math. Methods Med., 2016, 10.1155/2016/9093721 Xu, 2015, Efficient multi-atlas abdominal segmentation on clinically acquired CT with SIMPLE context learning, Med. Image Anal., 24, 18, 10.1016/j.media.2015.05.009 Yan, 2020, Learning from multiple datasets with heterogeneous and partial labels for universal lesion detection in CT, IEEE Trans. Med. Imaging Yang, J., Wickramasinghe, U., Ni, B., Fua, P., 2022. ImplicitAtlas: Learning Deformable Shape Templates in Medical Imaging. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 15861–15871. Yushkevich, 2006, User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability, Neuroimage, 31, 1116, 10.1016/j.neuroimage.2006.01.015 Zhang, 2020, Layer embedding analysis in convolutional neural networks for improved probability calibration and classification, IEEE Trans. Med. Imaging, 39, 3331, 10.1109/TMI.2020.2990625 Zhang, 2020 Zhang, 2010, Automatic liver segmentation using a statistical shape model with optimal surface detection, IEEE Trans. Biomed. Eng., 57, 2622, 10.1109/TBME.2010.2056369 Zhang, 2021 Zhou, 2021, Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registration, Med. Image Anal., 71, 10.1016/j.media.2021.102041 Zhou, 2006, Constructing a probabilistic model for automated liver region segmentation using non-contrast X-ray torso CT images, 856 Zhou, 2021, Models genesis, Med. Image Anal., 67, 10.1016/j.media.2020.101840