Analysis of the inter- and intra-observer agreement in radiographic evaluation of wrist fractures using the multimedia messaging service
Tóm tắt
Orthopaedic surgeons are often asked to evaluate X-rays of patients admitted to the Accident and Emergency Department with the suspicion of a wrist fracture or, in the case of an evident fracture, to decide the correct treatment. The aim of this study was to evaluate the feasibility of a correct interpretation of the images of injured wrists on the screen of a last generation mobile phone, in order to evaluate if the specialist could make the right diagnosis and choose the correct treatment. Five orthopaedic and one hand surgeons have evaluate the X-rays of 67 patients who sustained an injury to their wrist. In the case of fracture, they were asked to classify it according to the AO and Mayo classification systems. The evaluation of the images was accomplished through the PACS and using a mobile phone, at a different time. In order to check the inter- and intra-observer reliability, the same pattern was followed after a few months. The mobile phone showed basically the same agreement between the observers highlighting the worsening of the inter- and intra-observer reliability with the increment of the variables considered by a classification system. The present paper confirms that a last generation mobile phone can already be used in the clinical practise of orthopaedic surgeons on call who could use it as a useful device in remote or poorly served areas for a rapid and economic consultation The level of evidence of this case is economic and decision analysis, level 2
Tài liệu tham khảo
Abboud JA, Bozentka DJ, Beredjiklian PK. Telemedicine consultation for patients with upper extremity disorders is reliable. Clin Orthop Relat Res. 2005;435:250–7.
Andersen DJ, Blair WF, Steyers Jr CM, Adams B, El-Khouri GY, Brandser E. Classification of distal radius fractures: an analysis of interobserver reliability and intraobserver reproducibility. J Hand Surg. 1996;21-A(4):574–82.
Archbold HA, Guha AR, Shyamsundar S, McBride SJ, Charlwood P, Wray R. The use of multi-media messaging in the referral of musculoskeletal limb injuries to a tertiary trauma unit using: a 1-month evaluation. Injury. 2005;36(4):560–6.
Baruffaldi F, Gualdrini G, Toni A. Comparison of asynchronous and realtime teleconsulting for orthopaedic second opinion. J Telemed Telecare. 2002;8:297–301.
Bashshur R (1980) Technology serves the people: The story of a cooperative telemedicine project by NASA, the Indian Health Service and the Papago people. Superintendent of Documents, US Government Printing Office, Washington, D.C.
Bashshur RL, Armstrong PA, Youssef ZI. Telemedicine: exploration in the use of telecommunications in health care. Springfield: Charles C. Thomas; 1975.
Bashshur R, Lovett J. Assessment of telemedicine: results of the initial experience. Aviat Space Environ Med. 1977;48(1):65–70.
Bowns IR, Collins K, Walters SJ, McDonagh AJ. Telemedicine in dermatology: a randomised controlled trial. Health Technol Assess. 2006;10(43):1–39. iii-iv, ix-xi.
Chandhanayingyong C, Tangtrakulwanich B, Kiriratnikom T. Teleconsultation for emergency orthopaedic patients using the multimedia messaging service via mobile phones. J Telemed Telecare. 2007;13(4):193–6.
Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.
Cole JR, Memphis TN, Bindra Randip R, Evanoff BA, Gilula LA, Yamaguchi K, et al. Radiographic evaluation of osseous displacement following intra-articular fractures of the distal radius: reliability of plain radiography versus computed tomography. The J Hand Surg. 1997;22(5):792–800.
Cooney WP. Fractures of the distal radius: a modern treatment based classification. Orthop Clin N Am. 1993;24:211–6.
Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76(5):378–82.
Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.
Flinkkila T, Nikkola-Sitto A, Kaarela O, Paakko E, Raatikainen T. Poor interobserver reliability of AO classification of fractures of the distal radius. Additional computed tomography is of minor value. J Bone Joint Surg (Br). 1998;4:670–2.
Foote DR. Satellite communication for rural health care in Alaska. J Commun. 1977;27(4):173–82.
Hartvigsen G, Johansen MA, Hasvold P, Bellika JG, Arsand E, Arild E, et al. Challenges in telemedicine and eHealth: lessons learned from 20 years with telemedicine in Tromsø. Stud Health Technol Inf. 2007;129(Pt 1):82–6.
Hoffmann T, Russell T. Pre-admission orthopaedic occupational therapy home visits conducted using the Internet. J Telemed Telecare. 2008;14(2):83–7.
Hsieh CH, Jeng SF, Chen CY, Yin JW, Yang JC, Tsai HH, et al. Teleconsultation with the mobile camera–phone in remote evaluation of replantation potential. J Trauma. 2005;58(6):1208–12.
Hsieh CH, Tsai HH, Yin JW, Chen CY, Yang JC, Jeng SF. Teleconsultation with the mobile camera–phone in digital soft-tissue injury: a feasibility study. Plast Reconstr Surg. 2004;114(7):1776–82.
Jin WJ, Jiang LS, Shen L, Lu H, Cui YM, Zhou Q, et al. The interobserver reliability of the Cooney classification of distal radius fractures between experienced orthopaedic surgeons. J Hand Surg. 2007;32E(5):509–11.
Katz HP, Kaltsounis D, Halloran L, Mondor M. Patient safety and telephone medicine: some lessons from closed claim case review. J Gen Intern Med. 2008;23(5):517–22.
Kim DK, Yoo SK, Kim SH. Instant wireless transmission of radiological images using a personal digital assistant phone for emergency teleconsultation. J Telemed Telecare. 2005;11 Suppl 2:S58–61.
Kreder HJ, Hanel DP, McKee M, Jupiter J, McGillivary G, Swiontkowski MF. Consistency of AO fracture classification for the distal radius. J Bone Joint Surg [Br]. 1996;78-B:726–31.
Labiris G, Papadopoulis G, Lentaris G, Kafentzis M, Drakakis A. Internet based counseling to remote orthopedic patients. Acta Orthop Scand. 2004;75:366–7.
Lam TK, Preketes A, Gates R. Mobile phone photo messaging assisted communication in the assessment of hand trauma. ANZ J Surg. 2004;74:598–602.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Mann T, Colven R. A picture is worth more than a thousand words: enhancement of a pre-exam telephone consultation in dermatology with digital images. Acad Med. 2002;77(7):742–3.
Mendes de Oliveira Filho O, Dias Belangero W, Mendes Teles JB. Fraturas do radio distal: avaliacao das classificacoes. Rev Assoc Med Bras. 2004;50(1):55–61.
Moumoulidis I, Mani N, Patel H, Leong P. A novel use of photo messaging in the assessment of nasal fractures. J Telemed Telecare. 2007;13(8):387–90.
Muller ME, Nazarian S, Koch P. Classification AO des Factures. Paris: Springer; 1987.
Murphy RL, Bird KT. Telediagnosis: a new community health resource: observations on the feasibility of telediagnosis based on 1000 patient transcactions. Am J Public Health. 1974;64(2):113–9.
Naqvi SGA, Reynolds T, Kitsis C. Interobserver reliability and intraobserver reproducibility for distal radius fractures. J Hand Surg. 2009;00-E(4):1–3.
Ng WH, Wang E, Ng I. Multimedia Messaging Service teleradiology in the provision of emergency neurosurgery services. Surg Neurol. 2007;67(4):338–41.
Oskam J, Kingma J, Klasen HJ. Interrater reliability for the basic categories of the AO/ASIF’S system as a frame of reference for classifying distal radial fractures. Percept Motor Skills. 2001;92:589–94.
Ploegmakers JJW, Mader K, Pennig D, Verheyen CCPM. Four distal radial fracture classification systems tested amongst a large panel of Dutch trauma surgeons. Injury. 2007;38:1268–72.
Raikin SM, Bley LA, Leb RB. Emerging technology: remote analysis of traumatic musculoskeletal radiographs transmitted by electronic mail. J Orthop Trauma. 1999;13(7):516–9.
Ricci WM, Borrelli J. Teleradiology in orthopaedic surgery: impact on clinical decision making for acute fracture management. J Orthop Trauma. 2002;16(1):1–6.
Tangtrakulwanich B, Kwunpiroj W, Chongsuvivatwong V, Geater AF, Kiatsiriroj N. Teleconsultation with digital camera images is useful for fracture care. Clin Orthop Relat Res. 2006;449:308–12.
Tsai HH, Pong YP, Liang CC, Lin PY, Hsieh CH. Teleconsultation by using the mobile camera phone for remote management of the extremity wound: a pilot study. Ann Plast Surg. 2004;53(6):584–7.
Vladzymyrskyy AV. Our experience with telemedicine in traumatology and orthopedics. Ulus Travma Acil Cerrahi Derg. 2004;10(3):189–91.
Vuolio S, Winblad I, Ohinmaa A, Haukipuro K. Videoconferencing for orthopaedic outpatient. One year follow-up. J Telemed Telecare. 2003;9:8–11.
Yamada M, Watarai H, Andou T, Sakal N. Emergency image transfer system through a mobile telephone in Japan: technical note. Neurosurgery. 2003;52:986–90.