Knee osteoarthritis severity classification with ordinal regression module

Multimedia Tools and Applications - Tập 81 - Trang 41497-41509 - 2021
Ching Wai Yong1, Kareen Teo1, Belinda Pingguan Murphy1, Yan Chai Hum2, Yee Kai Tee2, Kaijian Xia3, Khin Wee Lai1
1Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur, Malaysia
2Department of Mechatronics and Biomedical Engineering, Lee Kong Chian Faculty of Engineering and Science, University Tunku Abdul Rahman, Kajang, Malaysia
3Changshu Hospital of Soochow University (Changshu No.1 People’s Hospital), Changshu, China

Tóm tắt

Osteoarthritis (OA) is a common form of knee arthritis which causes significant disability and is threatening to plague patient’s quality of life. Although this chronic condition does not lead to fatality, still there exists no known cure for OA. Diagnosis of OA can be confirmed primarily based on radiographic findings. Being a progressive disease, early identification of OA is crucial for clinical interventions to curtail the OA degeneration. Kellgren-Lawrence (KL) grading system has been traditionally employed to assess the knee OA severity. Due to the recent advancements of deep learning in computer vision, more studies have employed deep neural network in automatically predicting KL grade from plain knee joint radiograph. However, these studies treat KL grading as a multi-class classification task and ignore the inherent ordinal nature within the KL grades. In this study, we propose an ordinal regression module for neural networks to treat KL grading as an ordinal regression task. Our module takes an input from neural network and produces 4 cut-points to partition the prediction space into 5 respective KL grades. The proposed model is optimized by a cumulative-link loss function. Performance of the model is evaluated against various notable neural networks and significant improvements on the knee OA KL grade prediction were demonstrated.

Tài liệu tham khảo

United States Bone and Joint Initiative: The burden of musculoskeletal diseases in the United States (BMUS), third edition, 2014. Rosemont. Available at http://www.boneandjointburden.org. Accessed 18 July 2020 Antony J, McGuinness K, O’Connor NE, Moran K (2016) Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks. In: 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, pp 1195–1200. https://doi.org/10.1109/ICPR.2016.7899799 Antony J, McGuinness K, Moran K, O’Connor NE (2017) Automatic detection of knee joints and quantification of knee osteoarthritis severity using convolutional neural networks. In: Perner P (eds) Machine learning and data mining in pattern recognition. MLDM 2017. Lecture notes in computer science, vol 10358. Springer, Cham. https://doi.org/10.1007/978-3-319-62416-7_27 Braun HJ, Gold GE (2012) Diagnosis of osteoarthritis: imaging. Bone 51(2):278–288 Chen P, Gao L, Shi X, Allen K, Yang L (2019) Fully automatic knee osteoarthritis severity grading using deep neural networks with a novel ordinal loss. Comput Med Imaging Graph 75:84–92 Culvenor AG, Engen CN, Øiestad BE, Engebretsen L, Risberg MA (2015) Defining the presence of radiographic knee osteoarthritis: a comparison between the Kellgren and Lawrence system and OARSI atlas criteria. Knee Surg Sports Traumatol Arthrosc 23(12):3532–3539 Faur CI, Abu-Awwad A, Tudoran M et al (2020) Comparative study OCT versus MRI T2 in diagnosis of degenerative cartilage lesions. Research Square. https://doi.org/10.21203/rs.3.rs-29937/v1 Górriz M, Antony J, McGuinness K, Giró-i-Nieto X, O’Connor NE (2019) Assessing knee OA severity with CNN attention-based end-to-end architectures. In: International Conference on Medical Imaging with Deep Learning, pp. 197–214. PMLR Guccione AA, Felson DT, Anderson JJ, Anthony JM, Zhang Y, Wilson PW, Kelly-Hayes M, Wolf PA, Kreger BE, Kannel WB (1994) The effects of specific medical conditions on the functional limitations of elders in the Framingham study. Am J Public Health 84(3):351–358 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, pp. 770–778. https://doi.org/10.1109/CVPR.2016.90 Hirota K (2017) Development and application of optical coherence Elastography for detection of mechanical property changes occurring in early osteoarthritis. UC Riverside. ProQuest ID: Hirota_ucr_0032D_12874. Merritt ID: ark:/13030/m5hq8t98. Retrieved from https://escholarship.org/uc/item/5cw964kw Höfener H, Homeyer A, Weiss N, Molin J, Lundström CF, Hahn HK (2018) Deep learning nuclei detection: a simple approach can deliver state-of-the-art results. Comput Med Imaging Graph 70:43–52 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, pp. 2261–2269. https://doi.org/10.1109/CVPR.2017.243 Iglovikov VI, Rakhlin A, Kalinin AA, Shvets AA (2018) Paediatric bone age assessment using deep convolutional neural networks. In: Stoyanov D et al (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. DLMIA 2018, ML-CDS 2018. Lecture notes in computer science, vol 11045. Springer, Cham. https://doi.org/10.1007/978-3-030-00889-5_34 Jiang Z, Zhang H, Wang Y, Ko SB (2018) Retinal blood vessel segmentation using fully convolutional network with transfer learning. Comput Med Imaging Graph 68:1–15 Kellgren J, Lawrence J (1957) Radiological assessment of osteo-arthrosis. Ann Rheum Dis 16(4):494–502 Losina E, Walensky RP, Reichmann WM, Holt HL, Gerlovin H, Solomon DH, Jordan JM, Hunter DJ, Suter LG, Weinstein AM (2011) Impact of obesity and knee osteoarthritis on morbidity and mortality in older Americans. Ann Intern Med 154(4):217–226 Luyten FP, Denti M, Filardo G, Kon E, Engebretsen L (2012) Definition and classification of early osteoarthritis of the knee. Knee Surg Sports Traumatol Arthrosc 20(3):401–406 Man G, Mologhianu G (2014) Osteoarthritis pathogenesis–a complex process that involves the entire joint. J Med Life 7(1):37–41 Manjón JV, Coupé P, Raniga P, Xia Y, Desmond P, Fripp J, Salvado O (2018) MRI white matter lesion segmentation using an ensemble of neural networks and overcomplete patch-based voting. Comput Med Imaging Graph 69:43–51 Neogi T (2013) The epidemiology and impact of pain in osteoarthritis. Osteoarthr Cartil 21(9):1145–1153 Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, Köpf A, Yang E, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) PyTorch: An imperative style, high-performance deep learning library. NeurIPS Pedregosa F, Bach F, Gramfort A (2017) On the consistency of ordinal regression methods. J Mach Learn Res 18(1):1769–1803 Rakhlin A, Shvets A, Iglovikov V, Kalinin AA (2018) Deep convolutional neural networks for breast cancer histology image analysis. In: Campilho A, Karray F, ter Haar Romeny B (eds) Image analysis and recognition. ICIAR 2018. Lecture notes in computer science, vol 10882. Springer, Cham. https://doi.org/10.1007/978-3-319-93000-8_83 Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252 Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L (2018) Mobilenetv2: inverted residuals and linear bottlenecks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, pp. 4510–4520. https://doi.org/10.1109/CVPR.2018.00474 Sangha O (2000) Epidemiology of rheumatic diseases. Rheumatology 39(suppl_2):3–12 Schiphof D, Boers M, Bierma-Zeinstra SM (2008) Differences in descriptions of Kellgren and Lawrence grades of knee osteoarthritis. Ann Rheum Dis 67(7):1034–1036 Shamir L, Ling SM, Scott W, Hochberg M, Ferrucci L, Goldberg IG (2009) Early detection of radiographic knee osteoarthritis using computer-aided analysis. Osteoarthr Cartil 17(10):1307–1312 Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556 Su H, Xing F, Kong X, Xie Y, Zhang S, Yang L (2015) Robust cell detection and segmentation in histopathological images using sparse reconstruction and stacked denoising autoencoders. In: Navab N, Hornegger J, Wells W, Frangi A (eds) Medical image computing and computer-assisted intervention – MICCAI 2015. Lecture notes in computer science, vol 9351. Springer, Cham. https://doi.org/10.1007/978-3-319-24574-4_46 Szegedy C et al (2015) Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston,pp. 1–9. https://doi.org/10.1109/CVPR.2015.7298594 Tiulpin A, Thevenot J, Rahtu E, Lehenkari P, Saarakkala S (2018) Automatic knee osteoarthritis diagnosis from plain radiographs: a deep learning-based approach. Sci Rep 8(1):1–10 Tiulpin A, Klein S, Bierma-Zeinstra SM, Thevenot J, Rahtu E, van Meurs J, Oei EH, Saarakkala S (2019) Multimodal machine learning-based knee osteoarthritis progression prediction from plain radiographs and clinical data. Sci Rep 9(1):1–11 Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, pp. 5987–5995. https://doi.org/10.1109/CVPR.2017.634 Yong CW, Hum YC, Pingguan-Murphy B, Lai KW (2018) Train convolutional neural networks without well-segmented ground truth images for cartilage localization: data from the osteoarthritis initiatives. Adv Sci Lett 24(3):1771–1774