Survey of methods and principles in three-dimensional reconstruction from two-dimensional medical images
Tóm tắt
Three-dimensional (3D) reconstruction of human organs has gained attention in recent years due to advances in the Internet and graphics processing units. In the coming years, most patient care will shift toward this new paradigm. However, development of fast and accurate 3D models from medical images or a set of medical scans remains a daunting task due to the number of pre-processing steps involved, most of which are dependent on human expertise. In this review, a survey of pre-processing steps was conducted, and reconstruction techniques for several organs in medical diagnosis were studied. Various methods and principles related to 3D reconstruction were highlighted. The usefulness of 3D reconstruction of organs in medical diagnosis was also highlighted.
Tài liệu tham khảo
Richmond C (2004) Sir Godfrey Hounsfield. BMJ 329(7467):687. https://doi.org/10.1136/bmj.329.7467.687
He YB, Bai L, Aji T, Jiang Y, Zhao JM, Zhang JH et al (2015) Application of 3D reconstruction for surgical treatment of hepatic alveolar echinococcosis. World J Gastroenterol 21(35):10200-10207. https://doi.org/10.3748/wjg.v21.i35.10200
Werner R, Ehrhardt J, Schmidt R, Handels H (2009) Patient-specific finite element modeling of respiratory lung motion using 4D CT image data. Med Phys 36(5):1500-1511. https://doi.org/10.1118/1.3101820
Werner H, Lopes dos Santos JR, Fontes R, Belmonte S, Daltro P, Gasparetto E et al (2013) Virtual bronchoscopy for evaluating cervical tumors of the fetus. Ultrasound Obstet Gynecol 41(1):90-94. https://doi.org/10.1002/uog.11162
Haleem A, Javaid M (2019) 3D scanning applications in medical field: a literature-based review. Clin Epidemiol Glob Health 7(2):199-210. https://doi.org/10.1016/j.cegh.2018.05.006
Hardie NA, MacDonald G, Rubel EW (2004) A new method for imaging and 3D reconstruction of mammalian cochlea by fluorescent confocal microscopy. Brain Res 1000(1-2):200-210. https://doi.org/10.1016/j.brainres.2003.10.071
Zollhöfer M, Thies J, Garrido P, Bradley D, Beeler T, Pérez P et al (2018) State of the art on monocular 3D face reconstruction, tracking, and applications. Comput Graph Forum 37(2):523-550. https://doi.org/10.1111/cgf.13382
Østergaard M, Pedersen SJ, Døhn UM (2008) Imaging in rheumatoid arthritis-status and recent advances for magnetic resonance imaging, ultrasonography, computed tomography and conventional radiography. Best Pract Res Clin Rheumatol 22(6):1019-1044. https://doi.org/10.1016/j.berh.2008.09.014
Shiode R, Kabashima M, Hiasa Y, Oka K, Murase T, Sato Y et al (2021) 2D-3D reconstruction of distal forearm bone from actual X-ray images of the wrist using convolutional neural networks. Sci Rep 11:15249. https://doi.org/10.1038/s41598-021-94634-2
Kim H, Lee K, Lee D, Baek N (2019) 3D reconstruction of leg bones from X-ray images using CNN-based feature analysis. In: Proceedings of the 2019 international conference on information and communication technology convergence, IEEE, Jeju, 16-18 October 2019. https://doi.org/10.1109/ICTC46691.2019.8939984
Aubert B, Vazquez C, Cresson T, Parent S, de Guise JA (2019) Toward automated 3D spine reconstruction from biplanar radiographs using CNN for statistical spine model fitting. IEEE Trans Med Imaging 38(12):2796-2806. https://doi.org/10.1109/TMI.2019.2914400
Henzler P, Rasche V, Ropinski T, Ritschel T (2018) Single-image tomography: 3D volumes from 2D cranial X-rays. Comput Graph Forum 37(2):377-388. https://doi.org/10.1111/cgf.13369
Moura DC, Boisvert J, Barbosa JG, Labelle H, Tavares JMRS (2011) Fast 3D reconstruction of the spine from biplanar radiographs using a deformable articulated model. Med Eng Phys 33(8):924-933. https://doi.org/10.1016/j.medengphy.2011.03.007
André B, Dansereau J, Labelle H (1994) Optimized vertical stereo base radiographic setup for the clinical three-dimensional reconstruction of the human spine. J Biomech 27(8):1023-1025, 1027-1035. https://doi.org/10.1016/0021-9290(94)90219-4
Almeida DF, Astudillo P, Vandermeulen D (2021) Three-dimensional image volumes from two-dimensional digitally reconstructed radiographs: a deep learning approach in lower limb CT scans. Med Phys 48(5):2448-2457. https://doi.org/10.1002/mp.14835
Bai WJ, Shi WZ, de Marvao A, Dawes TJW, O’Regan DP, Cook SA et al (2015) A bi-ventricular cardiac atlas built from 1000+ high resolution MR images of healthy subjects and an analysis of shape and motion. Med Image Anal 26(1):133-145. https://doi.org/10.1016/j.media.2015.08.009
Ambellan F, Lamecker H, von Tycowicz C, Zachow S (2019) Statistical shape models: understanding and mastering variation in anatomy. In: Rea PM (ed) Biomedical visualisation. Advances in experimental medicine and biology, vol 1156. Springer, Cham, pp 67-84. https://doi.org/10.1007/978-3-030-19385-0_5
Prakash N N, Rajesh V, Inthiyaz S (2023) Review on Techniques and Indications of Liver Segmentation. EJMCM 10(1): 3690-3700
Lamecker H, Seebass M, Hege HC, Deuflhard P (2004) A 3D statistical shape model of the pelvic bone for segmentation. In: Proceedings of SPIE 5370, medical imaging 2004: image processing, SPIE, San Diego, 12 May 2004. https://doi.org/10.1117/12.534145
Vejjanugraha P, Kotani K, Kongprawechnon W, Kondo T, Tungpimolrut K (2021) Automatic screening of lung diseases by 3D active contour method for inhomogeneous motion estimation in CT image pairs. Walailak J Sci Technol 18(12):10573. https://doi.org/10.48048/wjst.2021.10573
Villard B, Grau V, Zacur E (2018) Surface mesh reconstruction from cardiac MRI contours. J Imaging 4(1):16. https://doi.org/10.3390/jimaging4010016
Boisvert J, Cheriet F, Pennec X, Labelle H, Ayache N (2008) Articulated spine models for 3-D reconstruction from partial radiographic data. IEEE Trans Biomed Eng 55(11):2565-2574. https://doi.org/10.1109/TBME.2008.2001125
Boisvert J, Moura DC (2011) Interactive 3D reconstruction of the spine from radiographs using a statistical shape model and second-order cone programming. In: Proceedings of the 2011 annual international conference of the IEEE engineering in medicine and biology society, IEEE, Boston, 30 August-3 September 2011. https://doi.org/10.1109/IEMBS.2011.6091386
Jiang HY, Cai JF, Zheng JM (2019) Skeleton-aware 3D human shape reconstruction from point clouds. In: Proceedings of the 2019 IEEE/CVF international conference on computer vision, IEEE, Seoul, 27 October-2 November 2019. https://doi.org/10.1109/ICCV.2019.00553
Schönberger JL, Frahm JM (2016) Structure-from-Motion revisited. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition, IEEE, Las Vegas, 27-30 June 2016. https://doi.org/10.1109/CVPR.2016.445
Fan HQ, Su H, Guibas L (2017) A point set generation network for 3D object reconstruction from a single image. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition, IEEE, Honolulu, 21-26 July 2017. https://doi.org/10.1109/CVPR.2017.264
Amenta N, Bern M, Kamvysselis M (1998) A new voronoi-based surface reconstruction algorithm. In: Proceedings of the 25th annual conference on computer graphics and interactive techniques, ACM, Orlando, 19-24 July 1998. https://doi.org/10.1145/280814.280947
Tatarchenko M, Dosovitskiy A, Brox T (2017) Octree generating networks: efficient convolutional architectures for high-resolution 3D outputs. In: Proceedings of the 2017 IEEE international conference on computer vision, IEEE, Venice, 22-29 October 2017. https://doi.org/10.1109/ICCV.2017.230
Allen B, Curless B, Popović Z (2003) The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans Graph 22(3):587-594. https://doi.org/10.1145/882262.882311
Digne J, Cohen-Steiner D, Alliez P, de Goes F, Desbrun M (2014) Feature-preserving surface reconstruction and simplification from defect-laden point sets. J Math Imaging Vis 48(2):369-382. https://doi.org/10.1007/s10851-013-0414-y
Narkhede A, Manocha D (1995) Fast polygon triangulation based on seidel’s algorithm. In: Paeth AW (ed) Graphics gems V: a collection of practical techniques for the computer graphics programmer. Academic Press, San Diego, pp 394-397. https://doi.org/10.1016/B978-0-12-543457-7.50059-0
Boissonnat JD, Geiger B (1993) Three-dimensional reconstruction of complex shapes based on the Delaunay triangulation. In: Proceedings of SPIE 1905, biomedical image processing and biomedical visualization, SPIE, San Jose, 29 July 1993. https://doi.org/10.1117/12.148710
Oliva JM, Perrin M, Coquillart S (1996) 3D reconstruction of complex polyhedral shapes from contours using a simplified generalized voronoi diagram. Comput Graph Forum 15(3):397-408. https://doi.org/10.1111/1467-8659.1530397
Pal NR, Pal SK (1993) A review on image segmentation techniques. Pattern Recognit 26(9):1277-1294. https://doi.org/10.1016/0031-3203(93)90135-J
Haralick RM, Shapiro LG (1985) Image segmentation techniques. Comput Vis, Graph, Image Process 29(1):100-132. https://doi.org/10.1016/S0734-189X(85)90153-7
Robertson TV (1973) Extraction and classification of objects in multispectral images. Purdue University, 1973
Dhanachandra N, Manglem K, Chanu YJ (2015) Image segmentation using K-means clustering algorithm and subtractive clustering algorithm. Procedia Comput Sci 54:764-771. https://doi.org/10.1016/j.procs.2015.06.090
Lopez-Molina C, De Baets B, Bustince H, Sanz J, Barrenechea E (2013) Multiscale edge detection based on Gaussian smoothing and edge tracking. Knowl-Based Syst 44:101-111. https://doi.org/10.1016/j.knosys.2013.01.026
Mumford DB, Shah J (1989) Optimal approximations by piecewise smooth functions and associated variational problems. Commun Pure Appl Math 42(5):577-685. https://doi.org/10.1002/cpa.3160420503
Getreuer P (2012) Chan-vese segmentation. Image Process Line 2:214-224. https://doi.org/10.5201/ipol.2012.g-cv
Kee Y, Kim J (2014) A convex relaxation of the ambrosio-tortorelli elliptic functionals for the Mumford-shah functional. In: Proceedings of the 2014 IEEE conference on computer vision and pattern recognition, IEEE, Columbus, 23-28 June 2014. https://doi.org/10.1109/CVPR.2014.519
Cerveri P, Sacco C, Olgiati G, Manzotti A, Baroni G (2017) 2D/3D reconstruction of the distal femur using statistical shape models addressing personalized surgical instruments in knee arthroplasty: a feasibility analysis. Int J Med Robot Comput Assist Surg 13(4):e1823. https://doi.org/10.1002/rcs.1823
Wang MR, Liu XB, Gao YX, Ma X, Soomro NQ (2017) Superpixel segmentation: a benchmark. Signal Process: Image Commun 56:28-39. https://doi.org/10.1016/j.image.2017.04.007
Chen XT, Zhang F, Zhang RY (2017) Medical image segmentation based on SLIC superpixels. In: Proceedings of SPIE 10245, international conference on innovative optical health science, Shanghai, SPIE, 5 January 2017. https://doi.org/10.1117/12.2258384
Pottmann H, Leopoldseder S, Hofer M (2002) Approximation with active B-spline curves and surfaces. In: Proceedings of the 10th pacific conference on computer graphics and applications, IEEE, Beijing, 9-11 October 2002. https://doi.org/10.1109/PCCGA.2002.1167835
Boehm W (1990) Algebraic and differential geometric methods in C.A.G.D. In: Dahmen W, Gasca M, Micchelli CA (eds) Computation of curves and surfaces. Nato science series C, vol 307. Springer, Dordrecht, pp 425-455. https://doi.org/10.1007/978-94-009-2017-0_13
Tuli M, Reddy NV, Saxena A (2006) Constrained shape modification of b-spline curves. Comput-Aided Des Appl 3(1-4):437-446. https://doi.org/10.1080/16864360.2006.10738482
Frangi AF, Rueckert D, Schnabel JA, Niessen WJ (2002) Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling. IEEE Trans Med Imaging 21(9):1151-1166. https://doi.org/10.1109/TMI.2002.804426
Sun X, Zhang XC, Ren XH, Sun HY, Wu L, Wang CF et al (2021) Multiscale co-reconstruction of lung architectures and inhalable materials spatial distribution. Adv Sci 8(8):2003941. https://doi.org/10.1002/advs.202003941
Wang Y, Kolotouros N, Daniilidis K, Badger M (2021) Birds of a feather: capturing avian shape models from images. In: Proceedings of the 2021 IEEE/CVF conference on computer vision and pattern recognition, IEEE, Nashville, 20-25 June 2021. https://doi.org/10.1109/CVPR46437.2021.01450
Lorensen WE, Cline HE (1987) Marching cubes: a high resolution 3D surface construction algorithm. ACM SIGGRAPH Comput Graph 21(4):163-169. https://doi.org/10.1145/37402.37422
Bernardini F, Mittleman J, Rushmeier H, Silva C, Taubin G (1999) The ball-pivoting algorithm for surface reconstruction. IEEE Trans Vis Comput Graph 5(4):349-359. https://doi.org/10.1109/2945.817351
Hoppe H, DeRose T, Duchamp T, McDonald J, Stuetzle W (1992) Surface reconstruction from unorganized points. In: Proceedings of the 19th annual conference on computer graphics and interactive techniques, ACM, Chicago, 27-31 July 1992. https://doi.org/10.1145/133994.134011
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th international conference on neural information processing systems, ACM, Lake Tahoe, 3-6 December 2012
Jarrett K, Kavukcuoglu K, Ranzato MA, LeCun Y (2009) What is the best multi-stage architecture for object recognition? In: Proceedings of the IEEE 12th international conference on computer vision, IEEE, Kyoto, 29 September-2 October 2009. https://doi.org/10.1109/ICCV.2009.5459469
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409
Szegedy C, Liu W, Jia YQ, Sermanet P, Reed S, Anguelov D et al (2015) Going deeper with convolutions. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition, IEEE, Boston, 7-12 June 2015. https://doi.org/10.1109/CVPR.2015.7298594
He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition, IEEE, Las Vegas, 27-30 June 2016. https://doi.org/10.1109/CVPR.2016.90
Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-ResNet and the impact of residual connections on learning. In: Proceedings of the 31st AAAI conference on artificial intelligence, AAAI Press, San Francisco, 4-9 February 2017. https://doi.org/10.1609/aaai.v31i1.11231
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention. 18th international conference, Munich, October 2015. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 9351. Springer, Cham, pp 234-241. https://doi.org/10.1007/978-3-319-24574-4_28
Çiçek O, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Ourselin S, Joskowicz L, Sabuncu MR, Unal G, Wells W (eds) Medical image computing and computer-assisted intervention - MICCAI 2016. 19th international conference, Athens, October 2016. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 9901. Springer, Cham, pp 424-432. https://doi.org/10.1007/978-3-319-46723-8_49
Cireşan D, Giusti A, Gambardella LM, Schmidhuber J (2012) Deep neural networks segment neuronal membranes in electron microscopy images. In: Proceedings of the 25th international conference on neural information processing systems, Curran Associates Inc, Lake Tahoe, 3-6 December 2012
Sharma N, Aggarwal LM (2010) Automated medical image segmentation techniques. J Med Phys 35(1):3-14. https://doi.org/10.4103/0971-6203.58777
Hancock ER, Kittler J (1990) Edge-labeling using dictionary-based relaxation. IEEE Trans Pattern Anal Mach Intell 12(2):165-181. https://doi.org/10.1109/34.44403
Law T, Itoh H, Seki H (1996) Image filtering, edge detection, and edge tracing using fuzzy reasoning. IEEE Trans Pattern Anal Mach Intell 18(5):481-491. https://doi.org/10.1109/34.494638
Kälviäinen H, Hirvonen P, Xu L, Oja E (1995) Probabilistic and non-probabilistic Hough transforms: overview and comparisons. Image Vis Comput 13(4):239-252. https://doi.org/10.1016/0262-8856(95)99713-B
Xu L, Oja E (1993) Randomized Hough transform (RHT): basic mechanisms, algorithms, and computational complexities. CVGIP: Image Underst 57(2):131-154. https://doi.org/10.1006/ciun.1993.1009
Shan P (2018) Image segmentation method based on K-mean algorithm. EURASIP J Image Video Process 2018(1):81. https://doi.org/10.1186/s13640-018-0322-6
Balafar MA (2014) Fuzzy C-mean based brain MRI segmentation algorithms. Artif intell Rev 41(3):441-449. https://doi.org/10.1007/s10462-012-9318-2
Liao S, Gao YZ, Oto A, Shen DG (2013) Representation learning: a unified deep learning framework for automatic prostate MR segmentation. In: Mori K, Sakuma I, Sato Y, Barillot C, Navab N (eds) Medical image computing and computer-assisted intervention. 16th international conference, Nagoya, September 2013. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 8150. Springer, Berlin, pp 254-261. https://doi.org/10.1007/978-3-642-40763-5_32
Le QV, Zou WY, Yeung SY, Ng AY (2011) Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis. In: Proceedings of the CVPR 2011, IEEE, Colorado Springs, 20-25 June 2011. https://doi.org/10.1109/CVPR.2011.5995496
Rouhi R, Jafari M, Kasaei S, Keshavarzian P (2015) Benign and malignant breast tumors classification based on region growing and CNN segmentation. Expert Syst Appl 42(3):990-1002. https://doi.org/10.1016/j.eswa.2014.09.020
Khotanzad A, Hong Y H (1990) Invariant image recognition by Zernike moments. IEEE T Pattern Anal 12(5): 489-497. https://doi.org/10.1109/34.55109
Gao YH, Huang R, Chen M, Wang Z, Deng JC, Chen YY et al (2019) FocusNet: imbalanced large and small organ segmentation with an end-to-end deep neural network for head and neck CT images. In: Shen DG, Liu Tm, Peters TM, Staib LH, Essert C, Zhou S et al (eds) Medical image computing and computer assisted intervention. 22nd international conference, Shenzhen, October 2019. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11766. Springer, Cham, pp 829-838. https://doi.org/10.1007/978-3-030-32248-9_92
Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y et al (2017) Brain tumor segmentation with deep neural networks. Med Image Anal 35:18-31. https://doi.org/10.1016/j.media.2016.05.004
Li HY, Liu XB, Boumaraf S, Gong XP, Liao DH, Ma XH (2020) Deep distance map regression network with shape-aware loss for imbalanced medical image segmentation. In: Liu MX, Yan PK, Lian CF, Cao XH (eds) Machine learning in medical imaging. 11th international workshop, MLMI 2020, held in conjunction with MICCAI 2020, Lima, October 2020. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 12436. Springer, Cham, pp 231-240. https://doi.org/10.1007/978-3-030-59861-7_24
Torbati N, Ayatollahi A, Kermani A (2014) An efficient neural network based method for medical image segmentation. Comput Biol Med 44:76-87. https://doi.org/10.1016/j.compbiomed.2013.10.029
Al-Ayyoub M, Abu-Dalo AM, Jararweh Y, Jarrah M, Sa’d MA (2015) A GPU-based implementations of the fuzzy C-means algorithms for medical image segmentation. J Supercomput 71(8):3149-3162. https://doi.org/10.1007/s11227-015-1431-y
Eschrich S, Ke JW, Hall LO, Goldgof DB (2003) Fast accurate fuzzy clustering through data reduction. IEEE Trans Fuzzy Syst 11(2):262-270. https://doi.org/10.1109/TFUZZ.2003.809902
Held K, Kops ER, Krause BJ, Wells WM, Kikinis R, Muller-Gartner HW (1997) Markov random field segmentation of brain MR images. IEEE Trans Med Imaging 16(6):878-886. https://doi.org/10.1109/42.650883
Deng HW, Clausi DA (2004) Unsupervised image segmentation using a simple MRF model with a new implementation scheme. Pattern Recognit 37(12):2323-2335. https://doi.org/10.1016/S0031-3203(04)00195-5
Monaco JP, Madabhushi A (2012) Class-specific weighting for Markov random field estimation: application to medical image segmentation. Med Image Anal 16(8):1477-1489. https://doi.org/10.1016/j.media.2012.06.007
Wang YF, Zhong ZC, Hua J (2020) DeepOrganNet: on-the-fly reconstruction and visualization of 3D/4D lung models from single-view projections by deep deformation network. IEEE Trans Vis Comput Graph 26(1):960-970. https://doi.org/10.1109/TVCG.2019.2934369
Chen WF, Ou HY, Liu KH, Li ZY, Liao CC, Wang SY et al (2021) In-series u-net network to 3D tumor image reconstruction for liver hepatocellular carcinoma recognition. Diagnostics 11(1):11. https://doi.org/10.3390/diagnostics11010011
Jeyaraj PR, Nadar ERS (2020) Dynamic image reconstruction and synthesis framework using deep learning algorithm. IET Image Process 14(7):1219-1226. https://doi.org/10.1049/iet-ipr.2019.0900
Shakarami A, Tarrah H, Mahdavi-Hormat A (2020) A CAD system for diagnosing Alzheimer's disease using 2D slices and an improved AlexNet-SVM method. Optik 212:164237. https://doi.org/10.1016/j.ijleo.2020.164237
Xie SP, Zheng XY, Chen Y, Xie LZ, Liu J, Zhang YD et al (2018) Artifact removal using improved GoogLeNet for sparse-view CT reconstruction. Sci Rep 8(1):6700. https://doi.org/10.1038/s41598-018-25153-w
Islam KT, Wijewickrema S, O’Leary S (2019) A rotation and translation invariant method for 3D organ image classification using deep convolutional neural networks. PeerJ Comput Sci 5:e181. https://doi.org/10.7717/peerj-cs.181
Ke HJ, Chen D, Li XL, Tang YB, Shah T, Ranjan R (2018) Towards brain big data classification: epileptic EEG identification with a lightweight VGGNet on global MIC. IEEE Access 6:14722-14733. https://doi.org/10.1109/ACCESS.2018.2810882
Seol YJ, Kim YJ, Kim YS, Cheon YW, Kim KG (2022) A study on 3D deep learning-based automatic diagnosis of nasal fractures. Sensors 22(2):506. https://doi.org/10.3390/s22020506
Li QF, Shen LL (2020) 3D neuron reconstruction in tangled neuronal image with deep networks. IEEE Trans Med Imaging 39(2):425-435. https://doi.org/10.1109/TMI.2019.2926568
He KM, Gkioxari G, Dollar P, Girshick R (2020) Mask R-CNN. IEEE Trans Pattern Anal Mach Intell 42(2):386-397. https://doi.org/10.1109/TPAMI.2018.2844175
Cheng TH, Wang XG, Huang LC, Liu WY (2020) Boundary-preserving mask R-CNN. In: Vedaldi A, Bischof H, Brox T, Frahm JM (eds) Computer vision. 16th European conference, Glasgow, August 2020. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 12359. Springer, Cham, pp 660-676. https://doi.org/10.1007/978-3-030-58568-6_39
Gkioxari G, Johnson J, Malik J (2019) Mesh R-CNN. In: Proceedings of the 2019 IEEE/CVF international conference on computer vision, IEEE, Seoul, 27 October-2 November 2019. https://doi.org/10.1109/ICCV.2019.00988
Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th international conference on learning representations, OpenReview.net, Toulon, 24-26 April 2017
Shen T, Gao J, Kar A, Fidler S (2020) Interactive annotation of 3D object geometry using 2D scribbles. In: Vedaldi A, Bischof H, Brox T, Frahm JM (eds) Computer vision. 16th European conference, Glasgow, August 2020. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 12362. Springer, Cham, pp 751-767. https://doi.org/10.1007/978-3-030-58520-4_44
Wang N, Zhang Y, Li Z, Fu Y, Liu W, Jiang Y G (2018) Pixel2mesh: Generating 3d mesh models from single RGB images. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer Vision – ECCV 2018. ECCV 2018. Lecture Notes in Computer Science(), vol 11215. Springer, Cham. https://doi.org/10.1007/978-3-030-01252-6_4
Xu TX, An D, Jia YT, Yue Y (2021) A review: point cloud-based 3D human joints estimation. Sensors 21(5):1684. https://doi.org/10.3390/s21051684
Yu Q, Yang CZ, Wei H (2022) Part-wise AtlasNet for 3D point cloud reconstruction from a single image. Knowl-Based Syst 242:108395. https://doi.org/10.1016/j.knosys.2022.108395
Yuan WT, Khot T, Held D, Mertz C, Hebert M (2018) PCN: point completion network. In: Proceedings of the 2018 international conference on 3D vision, IEEE, Verona, 5-8 September 2018. https://doi.org/10.1109/3DV.2018.00088
Huang K, Rhee DJ, Ger R, Layman R, Yang JZ, Cardenas CE et al (2021) Impact of slice thickness, pixel size, and CT dose on the performance of automatic contouring algorithms. J Appl Clin Med Phys 22(5):168-174. https://doi.org/10.1002/acm2.13207
Ding W, Li A, Wu J, Yang Z, Meng Y, Wang S et al (2013) Automatic macroscopic density artefact removal in a Nissl-stained microscopic atlas of whole mouse brain. J Microsc 251(2):168-177. https://doi.org/10.1111/jmi.12058
Bruno SR, Anathy V (2021) Lung epithelial endoplasmic reticulum and mitochondrial 3D ultrastructure: a new frontier in lung diseases. Histochem Cell Biol 155(2):291-300. https://doi.org/10.1007/s00418-020-01950-1
Durhan G, Duzgun SA, Akpınar MG, Demirkazık F, Arıyürek OM (2021) Imaging of congenital lung diseases presenting in the adulthood: a pictorial review. Insights Imaging 12(1):153. https://doi.org/10.1186/s13244-021-01095-2
Filho PPR, Cortez PC, da Silva Barros AC, Albuquerque VHC, Tavares JMRS (2017) Novel and powerful 3D adaptive crisp active contour method applied in the segmentation of CT lung images. Med Image Anal 35:503-516. https://doi.org/10.1016/j.media.2016.09.002
Li XP, Wang X, Dai YX, Zhang PB (2015) Supervised recursive segmentation of volumetric CT images for 3D reconstruction of lung and vessel tree. Comput Methods Programs Biomed 122(3):316-329. https://doi.org/10.1016/j.cmpb.2015.08.014
Le Moal J, Peillon C, Dacher JN, Baste JM (2018) Three-dimensional computed tomography reconstruction for operative planning in robotic segmentectomy: a pilot study. J Thorac Dis 10(1):196-201. https://doi.org/10.21037/jtd.2017.11.144
González Izard S, Sánchez Torres R, Alonso Plaza Ó, Juanes Méndez JA, García-Peñalvo FJ (2020) Nextmed: automatic imaging segmentation, 3D reconstruction, and 3D model visualization platform using augmented and virtual reality. Sensors 20(10):2962. https://doi.org/10.3390/s20102962
Joemai RMS, Geleijns J (2017) Assessment of structural similarity in CT using filtered backprojection and iterative reconstruction: a phantom study with 3D printed lung vessels. Br J Radiol 90(1079):20160519. https://doi.org/10.1259/bjr.20160519
Pereira LM, Wech T, Weng AM, Kestler C, Veldhoen S, Bley TA et al (2019) UTE-SENCEFUL: first results for 3D high-resolution lung ventilation imaging. Magn Reson Med 81(4):2464-2473. https://doi.org/10.1002/mrm.27576
Jin DK, Xu ZY, Tang YB, Harrison AP, Mollura DJ (2018) CT-realistic lung nodule simulation from 3D conditional generative adversarial networks for robust lung segmentation. In: Frangi A, Schnabel J, Davatzikos C, Alberola-López C, Fichtinger G (eds) Medical image computing and computer assisted intervention. 21st international conference, Granada, September 2018. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11071. Springer, Cham, pp 732-740. https://doi.org/10.1007/978-3-030-00934-2_81
Furumoto H, Shimada Y, Imai K, Maehara S, Maeda J, Hagiwara M et al (2018) Prognostic impact of the integration of volumetric quantification of the solid part of the tumor on 3DCT and FDG-PET imaging in clinical stage IA adenocarcinoma of the lung. Lung Cancer 121:91-96. https://doi.org/10.1016/j.lungcan.2018.05.001
Grothausmann R, Knudsen L, Ochs M, Mühlfeld C (2017) Digital 3D reconstructions using histological serial sections of lung tissue including the alveolar capillary network. Am J Physiol - Lung Cell Mol Physiol 312(2):L243-L257. https://doi.org/10.1152/ajplung.00326.2016
Morales-Navarrete H, Segovia-Miranda F, Klukowski P, Meyer K, Nonaka H, Marsico G et al (2015) A versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture. eLife 4:e11214. https://doi.org/10.7554/eLife.11214.039
Kasten Y, Doktofsky D, Kovler I (2020) End-to-end convolutional neural network for 3D reconstruction of knee bones from Bi-planar X-ray images. In: Deeba F, Johnson P, Würfl T, Ye JC (eds) Machine learning for medical image reconstruction. 3rd international workshop, MLMIR 2020, Held in conjunction with MICCAI 2020, Lima, October 2020. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 12450. Springer, Cham, pp 123-133. https://doi.org/10.1007/978-3-030-61598-7_12
Ciliberti FK, Guerrini L, Gunnarsson AE, Recenti M, Jacob D, Cangiano V et al (2022) CT-and MRI-based 3D reconstruction of knee joint to assess cartilage and bone. Diagnostics 12(2):279. https://doi.org/10.3390/diagnostics12020279
Hess S, Moser LB, Robertson EL, Behrend H, Amsler F, Iordache E et al (2022) Osteoarthritic and non-osteoarthritic patients show comparable coronal knee joint line orientations in a cross-sectional study based on 3D reconstructed CT images. Knee Surg, Sports Traumatol, Arthrosc 30(2):407-418. https://doi.org/10.1007/s00167-021-06740-3
Wu J, Mahfouz MR (2021) Reconstruction of knee anatomy from single-plane fluoroscopic x-ray based on a nonlinear statistical shape model. J Med Imaging 8(1):6001. https://doi.org/10.1117/1.JMI.8.1.016001
Bao LX, Rong SW, Shi ZJ, Wang J, Zhang Y (2021) Measurement of femoral posterior condylar offset and posterior tibial slope in normal knees based on 3D reconstruction. BMC Musculoskelet Disord 22(1):486. https://doi.org/10.1186/s12891-021-04367-6
Marzorati D, Sarti M, Mainardi L, Manzotti A, Cerveri P (2020) Deep 3D convolutional networks to segment bones affected by severe osteoarthritis in CT scans for PSI-based knee surgical planning. IEEE Access 8:196394-196407. https://doi.org/10.1109/ACCESS.2020.3034418
Puelles VG, Combes AN, Bertram JF (2021) Clearly imaging and quantifying the kidney in 3D. Kidney Int 100(4):780-786. https://doi.org/10.1016/j.kint.2021.04.042
Guliev B, Talyshinskii A, Akbarov I, Chukanov V, Vasilyev P (2022) Three-dimensional reconstruction of pelvicalyceal system of the kidney based on native CT images are 1-step away from the use of contrast agent. Turk J Urol 48(2):130-135. https://doi.org/10.5152/tud.2022.21329
Mercader C, Vilaseca A, Moreno JL, López A, Sebastià MC, Nicolau C et al (2019) Role of the three-dimensional printing technology in complex laparoscopic renal surgery: a renal tumor in a horseshoe kidney. Int Braz J Urol 45(6):1129-1135. https://doi.org/10.1590/s1677-5538.ibju.2019.0085
Chaussy Y, Vieille L, Lacroix E, Lenoir M, Marie F, Corbat L et al (2020) 3D reconstruction of Wilms’ tumor and kidneys in children: variability, usefulness and constraints. J Pediatr Urol 16(6):830.e1-830.e8. https://doi.org/10.1016/j.jpurol.2020.08.023
Les T, Markiewicz T, Dziekiewicz M, Lorent M (2020) Kidney boundary detection algorithm based on extended maxima transformations for computed tomography diagnosis. Appl Sci 10(21):7512. https://doi.org/10.3390/app10217512
Yeo CT, MacDonald A, Ungi T, Lasso A, Jalink D, Zevin B et al (2018) Utility of 3D reconstruction of 2D liver computed tomography/magnetic resonance images as a surgical planning tool for residents in liver resection surgery. J Surg Educ 75(3):792-797. https://doi.org/10.1016/j.jsurg.2017.07.031
Fang CH, An J, Bruno A, Cai XJ, Fan J, Fujimoto J et al (2020) Consensus recommendations of three-dimensional visualization for diagnosis and management of liver diseases. Hepatol Int 14(4):437-453. https://doi.org/10.1007/s12072-020-10052-y
Tatamov AA, Boraeva TT, Revazova AB, Alibegova AS, Dzhanaralieva KM, Tetueva AR et al (2021) Application of 3D technologies in surgery on the example of liver echinococcosis. J Pharm Res Int 33(40A):256-261. https://doi.org/10.9734/jpri/2021/v33i40A32242
Fang CH, Zhang P, Qi XL (2019) Digital and intelligent liver surgery in the new era: prospects and dilemmas. BioMedicine 41:693-701. https://doi.org/10.1016/j.ebiom.2019.02.017
Bjerke IE, Øvsthus M, Papp EA, Yates SC, Silvestri L, Fiorilli J et al (2018) Data integration through brain atlasing: human brain project tools and strategies. Eur Psychiatry 50:70-76. https://doi.org/10.1016/j.eurpsy.2018.02.004
Ebner M, Wang GT, Li WQ, Aertsen M, Patel PA, Aughwane R et al (2020) An automated framework for localization, segmentation and super-resolution reconstruction of fetal brain MRI. NeuroImage 206:116324. https://doi.org/10.1016/j.neuroimage.2019.116324
Du JL, Wang LL, Liu YL, Zhou ZX, He ZS, Jia YY (2020) Brain MRI super-resolution using 3D dilated convolutional encoder-decoder network. IEEE Access 8:18938-18950. https://doi.org/10.1109/ACCESS.2020.2968395
Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S et al (2014) Generative adversarial nets. In: Proceedings of the 27th international conference on neural information processing systems, MIT Press, Montreal, 8-13 December 2014
Song WN, Liang Y, Yang JW, Wang K, He L (2020) Oral-3D: reconstructing the 3D bone structure of oral cavity from 2D panoramic X-ray. arXiv preprint arXiv: 2003.08413. https://doi.org/10.1609/aaai.v35i1.16135
Nakao M, Tong F, Nakamura M, Matsuda T (2021) Image-to-graph convolutional network for deformable shape reconstruction from a single projection image. In: de Bruijne M, Cattin PC, Cotin S, Padoy N, Speidel S, Zheng YF et al (eds) Medical image computing and computer assisted intervention. 24th international conference, Strasbourg, September-October 2021. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 12904. Springer, Cham, pp 259-268. https://doi.org/10.1007/978-3-030-87202-1_25
Čavojská J, Petrasch J, Mattern D, Lehmann NJ, Voisard A, Böttcher P (2020) Estimating and abstracting the 3D structure of feline bones using neural networks on X-ray (2D) images. Commun Biol 3(1):337. https://doi.org/10.1038/s42003-020-1057-3
Chen X, Diaz-Pinto A, Ravikumar N, Frangi AF (2021) Deep learning in medical image registration. Prog Biomed Eng 3(1):012003. https://doi.org/10.1088/2516-1091/abd37c
de Vos BD, Berendsen FF, Viergever MA, Staring M, Išgum I (2017) End-to-end unsupervised deformable image registration with a convolutional neural network. In: Cardoso MJ, Arbel T, Carneiro G, Syeda-Mahmood T, Tavares JMRS, Moradi M et al (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. 3rd international workshop, DLMIA 2017, and 7th international workshop, ML-CDS 2017, held in conjunction with MICCAI 2017, Québec City, September 2017. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 10553. Springer, Cham, pp 204-212. https://doi.org/10.1007/978-3-319-67558-9_24
Lv J, Yang M, Zhang J, Wang XY (2018) Respiratory motion correction for free-breathing 3D abdominal MRI using CNN-based image registration: a feasibility study. Br J Radiol 91(1083):20170788. https://doi.org/10.1259/bjr.20170788
Fechter T, Baltas D (2020) One-shot learning for deformable medical image registration and periodic motion tracking. IEEE Trans Med Imaging 39(7):2506-2517. https://doi.org/10.1109/TMI.2020.2972616
Sokooti H, de Vos B, Berendsen F, Lelieveldt BPF, Išgum I, Staring M (2017) Nonrigid image registration using multi-scale 3D convolutional neural networks. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins D, Duchesne S (eds) Medical image computing and computer assisted intervention. 20th international conference, Quebec City, September 2017. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 10433. Springer, Cham, pp 232-239. https://doi.org/10.1007/978-3-319-66182-7_27
Fu YB, Lei Y, Wang TH, Higgins K, Bradley JD, Curran WJ et al (2020) LungRegNet: an unsupervised deformable image registration method for 4D-CT lung. Med Phys 47(4):1763-1774. https://doi.org/10.1002/mp.14065
Mahapatra D, Ge ZY (2019) Combining transfer learning and segmentation information with GANs for training data independent image registration. arXiv preprint arXiv:1903.10139
Shen ZY, Vialard FX, Niethammer M (2019) Region-specific diffeomorphic metric mapping. In: Proceedings of the 33rd conference on neural information processing systems, Vancouver, 8-14 December 2019
Balakrishnan G, Zhao A, Sabuncu MR, Guttag J, Dalca AV (2019) VoxelMorph: a learning framework for deformable medical image registration. IEEE Trans Med Imaging 38(8):1788-1800. https://doi.org/10.1109/TMI.2019.2897538
Yan P, Xu S, Rastinehad AR, Wood BJ (2018) Adversarial image registration with application for MR and TRUS image fusion. In: Shi YH, Suk HI, Liu MX (eds) Machine learning in medical imaging. 9th international workshop, MLMI 2018, held in conjunction with MICCAI 2018, Granada, September 2018. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11046. Springer, Cham, pp 197-204. https://doi.org/10.1007/978-3-030-00919-9_23
Heinrich MP (2019) Closing the gap between deep and conventional image registration using probabilistic dense displacement networks. In: Shen DG, Liu TM, Peters TM, Staib LH, Essert C, Zhou SA et al (eds) Medical image computing and computer assisted intervention. 22nd international conference, Shenzhen, October, 2019. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11769. Springer, Cham, pp 50-58. https://doi.org/10.1007/978-3-030-32226-7_6
Carass A, Roy S, Gherman A, Reinhold JC, Jesson A, Arbel T et al (2020) Evaluating white matter lesion segmentations with refined sørensen-dice analysis. Sci Rep 10(1):8242. https://doi.org/10.1038/s41598-020-64803-w
Li XZ, Li RH, Zhu L, Fu CW, Heng PA (2021) DNF-Net: a deep normal filtering network for mesh denoising. IEEE Trans Vis Comput Graph 27(10):4060-4072. https://doi.org/10.1109/TVCG.2020.3001681
Risser L, Vialard FX, Wolz R, Murgasova M, Holm DD, Rueckert D (2011) Simultaneous multi-scale registration using large deformation diffeomorphic metric mapping. IEEE Trans Med Imaging 30(10):1746-1759. https://doi.org/10.1109/TMI.2011.2146787
Salih OM, Rasheed MH, Siddeq MM, Rodrigues MA (2022) Image compression for quality 3D reconstruction. J King Saud Univ - Comput Inf Sci 34(5):2271-2287. https://doi.org/10.1016/j.jksuci.2020.07.012
Strümpler Y, Postels J, Yang R, van Gool L, Tombari F (2022) Implicit neural representations for image compression. In: Avidan S, Brostow G, Cissé M, Farinella GM, Hassner T (eds) Computer vision. 17th European conference, Tel Aviv, October, 2022. Lecture notes in computer science (ECCV: European conference on computer vision), vol 13686. Springer, Cham, pp 74-91. https://doi.org/10.1007/978-3-031-19809-0_5
Xing Y, Tan JQ, Hong PL, He YY, Hu M (2022) Mesh denoising based on recurrent neural networks. Symmetry 14(6):1233. https://doi.org/10.3390/sym14061233
Raghunandan KR, Dodmane R, Bhavya K, Rao NSK, Sahu AK (2023) Chaotic-map based encryption for 3D point and 3D mesh fog data in edge computing. IEEE Access 11:3545-3554. https://doi.org/10.1109/ACCESS.2022.3232461
Lyu WL, Cheng LL, Yin ZX (2022) High-capacity reversible data hiding in encrypted 3D mesh models based on multi-MSB prediction. Signal Process 201:108686. https://doi.org/10.1016/j.sigpro.2022.108686
Hashemi M, Akhbari M, Jutten C (2022) Delve into multiple sclerosis (MS) lesion exploration: a modified attention U-Net for MS lesion segmentation in Brain MRI. Comput Biol Med 145:105402. https://doi.org/10.1016/j.compbiomed.2022.105402
Zhang WR, Yao G, Yang B, Zheng WF, Liu C (2022) Motion prediction of beating heart using spatio-temporal LSTM. IEEE Signal Process Lett 29:787-791. https://doi.org/10.1109/LSP.2022.3154317
J Chaki N Dey 2018 A beginner’s guide to image preprocessing techniques CRC Press, Boca Raton. https://doi.org/10.1201/9780429441134
Chang AX, Funkhouser T, Guibas L, Hanrahan P, Huang QX, Li ZM et al (2015) ShapeNet: an information-Rich 3D model repository. arXiv preprint arXiv: 1512.03012
Wu ZR, Song SR, Khosla A, Yu F, Zhang LG, Tang XO et al (2015) 3D ShapeNets: a deep representation for volumetric shapes. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition, IEEE, Boston, 7-12 June 2015
