Neural networks for automatic scoring of arthritis disease activity on ultrasound images

RMD Open - Tập 5 Số 1 - Trang e000891 - 2019
J Andersen1, Jannik S. Pedersen1, Martin Sundahl Laursen1, Kathrine Holtz1, Jakob Grauslund2,3, Thiusius Rajeeth Savarimuthu1, Søren Andreas Just4,2
1The Maersk Mc-Kinney Moller Institute, Syddansk Universitet
2Odense Universitetshospital
3Research Unit of Ophthalmology, Department of Opthalmology
4Department of Rheumatology

Tóm tắt

BackgroundThe development of standardised methods for ultrasound (US) scanning and evaluation of synovitis activity by the OMERACT-EULAR Synovitis Scoring (OESS) system is a major step forward in the use of US in the diagnosis and monitoring of patients with inflammatory arthritis. The variation in interpretation of disease activity on US images can affect diagnosis, treatment and outcomes in clinical trials. We, therefore, set out to investigate if we could utilise neural network architecture for the interpretation of disease activity on Doppler US images, using the OESS scoring system.MethodsTwo state-of-the-art neural networks were used to extract information from 1342 Doppler US images from patients with rheumatoid arthritis (RA). One neural network divided images as either healthy (Doppler OESS score 0 or 1) or diseased (Doppler OESS score 2 or 3). The other to score images across all four of the OESS systems Doppler US scores (0–3). The neural networks were hereafter tested on a new set of RA Doppler US images (n=176). Agreement between rheumatologist’s scores and network scores was measured with the kappa statistic.ResultsFor the neural network assessing healthy/diseased score, the highest accuracies compared with an expert rheumatologist were 86.4% and 86.9% with a sensitivity of 0.864 and 0.875 and specificity of 0.864 and 0.864, respectively. The other neural network developed to four class Doppler OESS scoring achieved an average per class accuracy of 75.0% and a quadratically weighted kappa score of 0.84.ConclusionThis study is the first to show that neural network technology can be used in the scoring of disease activity on Doppler US images according to the OESS system.

Từ khóa


Tài liệu tham khảo

10.1016/S0140-6736(17)31472-1

Terslev, 2017, Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce-Part 2: reliability and application to multiple joints of a standardised consensus-based scoring system, RMD Open, 3, 10.1136/rmdopen-2016-000427

Paulshus Sundlisæter, 2018, Clinical and ultrasound remission after 6 months of treat-to-target therapy in early rheumatoid arthritis: associations to future good radiographic and physical outcomes, Ann Rheum Dis, 77, 1421, 10.1136/annrheumdis-2017-212830

10.1136/ard.2004.030387

D'Agostino, 2017, Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce-Part 1: definition and development of a standardised, consensus-based scoring system, RMD Open, 3, 10.1136/rmdopen-2016-000428

Hammer HB , Kvien TK , Terslev L . Ultrasound of the Hand is sufficient to detect subclinical inflammation in rheumatoid arthritis remission: a post hoc longitudinal study. Arthritis Res Ther 2017;19.doi:10.1186/s13075-017-1428-4

Terslev L , Naredo E , Aegerter P , et al . Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce-Part 2: reliability and application to multiple joints of a standardised consensus-based scoring system. RMD Open 2017;3.doi:10.1136/rmdopen-2016-000427

10.1136/ard.2011.152926

10.1007/s11263-015-0816-y

10.1038/nature14539

Torp-Pedersen, 2015, Power and color Doppler ultrasound settings for inflammatory flow: impact on scoring of disease activity in patients with rheumatoid arthritis, Arthritis Rheumatol, 67, 386, 10.1002/art.38940

Chollet F . Keras, 2015. Available: https://keras.io

OSDI . TensorFlow: a system for large-scale machine learning, 2016.

Simonyan K , Zisserman A . Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv 2014;14091556.

Rethinking the inception architecture for computer vision. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.

10.1007/s10067-014-2841-6

10.1002/art.22437

Thông tin
Thông tin xuất bản

RMD Open

Tập 5 Số 1

e000891

Thông tin tác giả