Design and development of a content-based medical image retrieval system for spine vertebrae irregularity

Springer Science and Business Media LLC - Tập 14 Số 1 - Trang 1-24 - 2015
Mustapha, Aouache1, Hussain, Aini1, Samad, Salina Abdul1, Zulkifley, Mohd Asyraf1, Diyana Wan Zaki, Wan Mimi1, Hamid, Hamzaini Abdul2
1Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Univeristi Kebangsaan Malaysia, Selangor DE, Malaysia
2Department of Radiology, Faculty of Medicine, Univeristi Kebangsaan Malaysia Medical Centre, Jalan Yaacob Latif, Kuala Lumpur, Malaysia

Tóm tắt

Content-based medical image retrieval (CBMIR) system enables medical practitioners to perform fast diagnosis through quantitative assessment of the visual information of various modalities. In this paper, a more robust CBMIR system that deals with both cervical and lumbar vertebrae irregularity is afforded. It comprises three main phases, namely modelling, indexing and retrieval of the vertebrae image. The main tasks in the modelling phase are to improve and enhance the visibility of the x-ray image for better segmentation results using active shape model (ASM). The segmented vertebral fractures are then characterized in the indexing phase using region-based fracture characterization (RB-FC) and contour-based fracture characterization (CB-FC). Upon a query, the characterized features are compared to the query image. Effectiveness of the retrieval phase is determined by its retrieval, thus, we propose an integration of the predictor model based cross validation neural network (PMCVNN) and similarity matching (SM) in this stage. The PMCVNN task is to identify the correct vertebral irregularity class through classification allowing the SM process to be more efficient. Retrieval performance between the proposed and the standard retrieval architectures are then compared using retrieval precision (Pr@M) and average group score (A GS ) measures. Experimental results show that the new integrated retrieval architecture performs better than those of the standard CBMIR architecture with retrieval results of cervical (A GS  > 87%) and lumbar (A GS  > 82%) datasets. The proposed CBMIR architecture shows encouraging results with high Pr@M accuracy. As a result, images from the same visualization class are returned for further used by the medical personnel.

Tài liệu tham khảo

citation_journal_title=Am J Publ Health; citation_title=Osteoporosis recognition: correcting Gehlbach et al; citation_author=RC Probst, CG More, EG Baxley, JA Shinogle; citation_volume=92; citation_publication_date=2002; citation_pages=1885; citation_doi=10.2105/AJPH.92.12.1885; citation_id=CR1 citation_journal_title=J Clin Endocrinol Metab; citation_title=Effect of monitoring bone turnover markers on persistence with risedronate treatment of postmenopausal osteoporosis; citation_author=DD Pierre, V Bernard, E Richard, R Christian, APP Huibert, DR Johann; citation_volume=92; citation_publication_date=2007; citation_pages=1296-1304; citation_doi=10.1210/jc.2006-1526; citation_id=CR2 citation_journal_title=Sci Res Essays; citation_title=A new approach for noise reduction in spine radiograph images using a non-linear contrast adjustment scheme based adaptive factor; citation_author=M Aouache, A Hussain, SA Samad; citation_volume=6; citation_issue=20; citation_publication_date=2011; citation_pages=4246-58; citation_id=CR3 citation_journal_title=Comput Vis Image Underst; citation_title=ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases; citation_author=S Chi-Ren, EB Carla, CK Avinash, K Akio, MA Alex, AB Lynn; citation_volume=75; citation_publication_date=1999; citation_pages=111-32; citation_doi=10.1006/cviu.1999.0768; citation_id=CR4 citation_journal_title=Health Informatics J; citation_title=A review of intelligent content-based indexing and browsing of medical images; citation_author=LHY Tang, R Hanka, HS Horace; citation_volume=5; citation_publication_date=1999; citation_pages=40-9; citation_doi=10.1177/146045829900500107; citation_id=CR5 citation_journal_title=Health Inform J; citation_title=A review of intelligent content-based indexing and browsing of medical images; citation_author=LHY Tang, R Hanka, HS Horace; citation_volume=5; citation_issue=1; citation_publication_date=1999; citation_pages=40-9; citation_doi=10.1177/146045829900500107; citation_id=CR6 citation_title=WebMIRS: Web-based medical information retrieval system; citation_publication_date=1997; citation_id=CR7; citation_author=RL Long; citation_author=RP Stanley; citation_author=G Gin-Hua; citation_author=CL Reva; citation_author=N Leif; citation_author=RT George; citation_publisher=Photonics West’98 Electronic Imaging citation_title=Pathfinder: Multiresolution region-based searching of pathology images using IRM; citation_publication_date=2000; citation_id=CR8; citation_author=JZ Wang; citation_publisher=Proceedings of the AMIA Symposium citation_title=Content-based image retrieval in medical applications: a novel multistep approach; citation_publication_date=1999; citation_id=CR9; citation_author=TM Lehmann; citation_author=BB Wein; citation_author=J Dahmen; citation_author=J Bredno; citation_author=F Vogelsang; citation_author=M Kohnen; citation_publisher=Electronic Imaging, International Society for Optics and Photonics citation_journal_title=Pattern Recognit; citation_title=A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video; citation_author=S Antani, R Kasturi, R Jain; citation_volume=35; citation_issue=4; citation_publication_date=2002; citation_pages=945-65; citation_doi=10.1016/S0031-3203(01)00086-3; citation_id=CR10 citation_journal_title=Ultrasound Med Biol; citation_title=Retrieval technique for the diagnosis of solid breast tumors on sonogram; citation_author=WJ Kuo, RF Chang, CC Lee, WK Moon, DR Chen; citation_volume=28; citation_issue=7; citation_publication_date=2002; citation_pages=903-9; citation_doi=10.1016/S0301-5629(02)00541-0; citation_id=CR11 citation_journal_title=Biomed Eng Online; citation_title=Computer-aided diagnosis of breast microcalcifications based on dual-tree complex wavelet transform; citation_author=W Jian, X Sun, S Luo; citation_volume=11; citation_issue=1; citation_publication_date=2012; citation_pages=96; citation_doi=10.1186/1475-925X-11-96; citation_id=CR12 citation_journal_title=Biomed Eng Online; citation_title=Definition of an automated Content-Based Image Retrieval (CBIR) system for the comparison of dermoscopic images of pigmented skin lesions; citation_author=A Baldi, R Murace, E Dragonetti, M Manganaro, O Guerra, S Bizzi; citation_volume=8; citation_issue=1; citation_publication_date=2009; citation_pages=18; citation_doi=10.1186/1475-925X-8-18; citation_id=CR13 citation_journal_title=Inf Technol Biomed; citation_title=A spine X-ray image retrieval system using partial shape matching; citation_author=X Xu, DJ Lee, S Antani, LR Long; citation_volume=12; citation_issue=1; citation_publication_date=2008; citation_pages=100-8; citation_doi=10.1109/TITB.2007.904149; citation_id=CR14 citation_journal_title=Data Knowl Eng; citation_title=CBIR of spine X-ray images on inter-vertebral disc space and shape profiles using feature ranking and voting consensus; citation_author=DJ Lee, S Antani, Y Chang, K Gledhill, L Rodney Long, P Christensen; citation_volume=68; citation_issue=12; citation_publication_date=2009; citation_pages=1359-69; citation_doi=10.1016/j.datak.2009.07.008; citation_id=CR15 citation_journal_title=Med Image Anal; citation_title=Optimal embedding for shape indexing in medical image databases; citation_author=X Qian, HD Tagare, RK Fulbright, R Long, S Antani; citation_volume=14; citation_issue=3; citation_publication_date=2010; citation_pages=243-54; citation_doi=10.1016/j.media.2010.01.001; citation_id=CR16 citation_journal_title=J Digital Imaging; citation_title=Content-based image retrieval in radiology: current status and future directions; citation_author=CB Akgul, DL Rubin, S Napel, CF Beaulieu, H Greenspan, B Acar; citation_volume=24; citation_issue=2; citation_publication_date=2011; citation_pages=208-22; citation_doi=10.1007/s10278-010-9290-9; citation_id=CR17 citation_journal_title=J Digital Imaging; citation_title=Content-based medical image retrieval: a survey of applications to multidimensional and multimodality data; citation_author=A Kumar, J Kim, W Cai, M Fulham, D Feng; citation_volume=26; citation_issue=6; citation_publication_date=2013; citation_pages=1025-39; citation_doi=10.1007/s10278-013-9619-2; citation_id=CR18 citation_journal_title=Southern Med J; citation_title=Morphologic study of lumbar vertebral osteophytes; citation_author=M Heggeness, B Doherty; citation_volume=91; citation_issue=2; citation_publication_date=1998; citation_pages=187-89; citation_doi=10.1097/00007611-199802000-00012; citation_id=CR19 citation_journal_title=Comput Med Imaging Graph; citation_title=Size-invariant descriptors for detecting regions of abnormal growth in cervical vertebrae; citation_author=RJ Stanley, S Antani, LR Long, GR Thoma, K Gupta, M Das; citation_volume=32; citation_issue=1; citation_publication_date=2008; citation_pages=44-52; citation_doi=10.1016/j.compmedimag.2007.09.002; citation_id=CR20 citation_title=Comparative study of spine vertebra shape retrieval using learning-based feature selection; citation_inbook_title=Computer-based medical systems, 2009. CBMS 2009. 22nd IEEE international symposium on; citation_publication_date=2009; citation_id=CR21; citation_author=H Guan; citation_author=S Antani; citation_author=LR Long; citation_author=GR Thoma citation_title=Evaluating partial shape queries for pathology-based retrieval of vertebra; citation_inbook_title=Proc. 8th World multiconference systemics, cybernetics informatics (SCI 2004); citation_publication_date=2004; citation_id=CR22; citation_author=J Shou; citation_author=S Antani; citation_author=LR Long; citation_author=GR Thoma citation_journal_title=Comput Med Imaging Graph; citation_title=Anterior osteophyte discrimination in lumbar vertebrae using size-invariant features; citation_author=M Cherukuri, RJ Stanley, R Long, S Antani, G Thoma; citation_volume=12; citation_issue=1; citation_publication_date=2004; citation_pages=99-108; citation_doi=10.1016/j.compmedimag.2003.09.002; citation_id=CR23 citation_journal_title=Computing; citation_title=A simplified B-spline computation routine; citation_author=ET Lee; citation_volume=29; citation_issue=4; citation_publication_date=1982; citation_pages=365-71; citation_doi=10.1007/BF02246763; citation_id=CR24 citation_journal_title=Comput Vision Image Underst; citation_title=Active shape models-their training and application; citation_author=TF Cootes, CJ Taylor, DH Cooper, J Graham; citation_volume=61; citation_issue=1; citation_publication_date=1995; citation_pages=38-59; citation_doi=10.1006/cviu.1995.1004; citation_id=CR25 citation_title=Texture analysis using Gabor wavelets; citation_inbook_title=Proc. SPIE Human Vision Electron. Imaging,; citation_publication_date=1996; citation_id=CR26; citation_author=GA Naghdy; citation_author=J Wang; citation_author=PO Ogunbona citation_journal_title=Syst Man Cybernet IEEE Trans; citation_title=Textural features for image classification; citation_author=RM Haralick, K Shanmugam, IH Dinstein; citation_volume=6; citation_publication_date=1973; citation_pages=610-21; citation_doi=10.1109/TSMC.1973.4309314; citation_id=CR27 citation_journal_title=Automatica; citation_title=A threshold selection method from gray-level histograms; citation_author=N Otsu; citation_volume=11; citation_publication_date=1975; citation_pages=23-7; citation_id=CR28 citation_journal_title=Signal Process; citation_title=Topographic distance and watershed lines; citation_author=F Meyer; citation_volume=38; citation_issue=1; citation_publication_date=1994; citation_pages=113-25; citation_doi=10.1016/0165-1684(94)90060-4; citation_id=CR29 citation_journal_title=Pattern Recognit; citation_title=Review of shape representation and description techniques; citation_author=D Zhang, G Lu; citation_volume=37; citation_issue=1; citation_publication_date=2004; citation_pages=1-19; citation_doi=10.1016/j.patcog.2003.07.008; citation_id=CR30 citation_journal_title=IEEE Trans Pattern Anal Mach Intell; citation_title=An experimental comparison of autoregressive and Fourier-based descriptors in 2D shape classification; citation_author=H Kauppinen, T Seppanen, M Pietikainen; citation_volume=17; citation_issue=2; citation_publication_date=1995; citation_pages=201-7; citation_doi=10.1109/34.368168; citation_id=CR31 citation_journal_title=Opt Lasers Eng; citation_title=Retrieval and classification of shape-based objects using Fourier, generic Fourier, and wavelet-Fourier descriptors technique: A comparative study; citation_author=RB Yadav, NK Nishchal, AK Gupta, VK Rastogi; citation_volume=45; citation_issue=6; citation_publication_date=2007; citation_pages=695-708; citation_doi=10.1016/j.optlaseng.2006.11.001; citation_id=CR32 citation_title=A contour-oriented approach to shape analysis; citation_publication_date=1991; citation_id=CR33; citation_author=V Otterloo; citation_author=J Peter; citation_publisher=Prentice Hall International Ltd citation_journal_title=Chemom Intell Lab Syst; citation_title=Receiver operating characteristics curves and related decision measures: A tutorial; citation_author=CD Brown, HT Davis; citation_volume=80; citation_issue=1; citation_publication_date=2006; citation_pages=24-38; citation_doi=10.1016/j.chemolab.2005.05.004; citation_id=CR34 citation_journal_title=Pattern Recognit Lett; citation_title=Performance evaluation in content-based image retrieval: overview and proposals; citation_author=H Müller, W Müller, DM Squire, S Marchand-Maillet, T Pun; citation_volume=22; citation_issue=5; citation_publication_date=2001; citation_pages=593-601; citation_doi=10.1016/S0167-8655(00)00118-5; citation_id=CR35 citation_journal_title=Biomed Eng Online; citation_title=Definition of an automated Content-Based Image Retrieval (CBIR) system for the comparison of dermoscopic images of pigmented skin lesions; citation_author=B Alfonso, M Raffaele, D Emanuele, M Mario, G Oscar, B Stefano; citation_volume=8; citation_issue=1; citation_publication_date=2009; citation_pages=18; citation_doi=10.1186/1475-925X-8-18; citation_id=CR36