Association between Radiologists' Experience and Accuracy in Interpreting Screening Mammograms
Tóm tắt
Radiologists have been observed to differ, sometimes substantially, both in their interpretations of mammograms and in their recommendations for follow-up. The aim of this study was to determine how factors related to radiologists' experience affect the accuracy of mammogram readings. We selected a random sample of screening mammograms from a population-based breast cancer screening program. The sample was composed of 30 women with histopathologically-confirmed breast cancer and 170 women without breast cancer after a 2-year follow-up (the proportion of cancers was oversampled). These 200 mammograms were read by 21 radiologists routinely interpreting mammograms, with different amount of experience, and by seven readers who did not routinely interpret mammograms. All readers were blinded to the results of the screening. A positive assessment was considered when a BI-RADS III, 0, IV, V was reported (additional evaluation required). Diagnostic accuracy was calculated through sensitivity and specificity. Average specificity was higher in radiologists routinely interpreting mammograms with regard to radiologists who did not (66% vs 56%; p < .001). Multivariate analysis based on routine readers alone showed that specificity was higher among radiologists who followed-up cases for which they recommended further workup (feedback) (OR 1.37; 95% CI 1.03 to 1.85), those spending less than 25% of the working day on breast radiology (OR 1.49; 95% CI 1.18 to 1.89), and those aged more than 45 years old (OR 1.33; 95% CI 1.12 to 1.59); the variable of average annual volume of mammograms interpreted by radiologists, classified as more or less than 5,000 mammograms per year, was not statistically significant (OR 1.06; 95% CI 0.90 to 1.25). Among radiologists who read routinely, volume is not associated with better performance when interpreting screening mammograms, although specificity decreased in radiologists not routinely reading mammograms. Follow-up of cases for which further workup is recommended might reduce variability in mammogram readings and improve the quality of breast cancer screening programs.
Tài liệu tham khảo
Elmore JG, Wells CK, Lee CH, Howard DH, Feinstein AR: Variability in radiologists' interpretations of mammograms. N Engl J Med. 1994, 331: 1493-1499. 10.1056/NEJM199412013312206.
Beam CA, Layde PM, Sullivan DC: Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med. 1996, 156: 209-213. 10.1001/archinte.156.2.209.
Carney PA, Elmore JG, Abraham LA, Gerrity MS, Hendrick RE, Taplin SH, Barlow WE, Cutter GR, Poplack SP, D'Orsi CJ: Radiologist uncertainty and the interpretation of screening. Med Decis Making. 2004, 24: 255-264. 10.1177/0272989X04265480.
Bull AR, Campbell MJ: Assessment of the psychological impact of a breast screening programme. Br J Radiol. 1991, 64 (762): 510-515.
Lampic C, Thurfjell E, Bergh J, Sjoden PO: Short- and long-term anxiety and depression in women recalled after breast cancer screening. Eur J Cancer. 2001, 37: 463-469. 10.1016/S0959-8049(00)00426-3.
Castells X, Molins E, Macià F: Cumulative false positive recall rate and association with participant related factors in a population based breast cancer screening programme. J Epidemiol Community Health. 2006, 60: 316-321. 10.1136/jech.2005.042119.
Theberge I, Hebert-Croteau N, Langlois A, Major D, Brisson J: Volume of screening mammography and performance in the Quebec population-based Breast Cancer Screening Program. CMAJ. 2005, 172 (2): 195-199.
Barlow WE, Chi C, Carney PA, Taplin SH, D'Orsi C, Cutter G, Hendrick RE, Elmore JG: Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2004, 96 (24): 1840-1850.
Elmore JG, Miglioretti DL, Carney PA: Does practice make perfect when interpreting mammography? Part II. J Natl Cancer Inst. 2003, 95: 250-252.
Kan L, Olivotto IA, Warren Burhenne LJ, Sickles EA, Coldman AJ: Standardized abnormal interpretation and cancer detection ratios to assess reading volume and reader performance in a breast screening program. Radiology. 2000, 215 (2): 563-567.
Elmore JG, Wells CK, Howard DH: Does diagnostic accuracy in mammography depend on radiologists' experience?. J Womens Health. 1998, 7 (4): 443-449.
Perry N, Broeders M, de Wolf C, Törnberg S, Holland R, von Karsa L, Puthaar E, eds: European Commission. European Guidelines for Quality Assurance in Breast Cancer Screening and Diagnosis. 2006, Luxembourg: Office for Official Publications of the European Communities, Fourth
Baker JA, Kornguth PJ, Floyd CE: Breast imaging reporting and data system standardized mammography lexicon: observer variability in lesion description. AJR Am J Roentgenol. 1996, 166 (4): 773-778.
Lehman C, Holt S, Peacock S, White E, Urban N: Use of the American College of Radiology BI-RADS guidelines by community radiologists: concordance of assessments and recommendations assigned to screening mammograms. AJR Am J Roentgenol. 2002, 179 (1): 15-20.
Smith-Bindman R, Chu P, Miglioretti DL, Quale C, Rosenberg RD, Cutter G, Geller B, Bacchetti P, Sickles EA, Kerlikowske K: Physician predictors of mammographic accuracy. J Natl Cancer Inst. 2005, 97 (5): 358-367.
Esserman L, Cowley H, Eberle C, Kirkpatrick A, Chang S, Berbaum K, Gale A: Improving the accuracy of mammography: volume and outcome relationships. J Natl Cancer Inst. 2002, 94 (5): 369-375.
Beam CA, Conant EF, Sickles EA: Association of volume and volume-independent factors with accuracy in screening mammogram interpretation. J Natl Cancer Inst. 2003, 95 (4): 282-290.
Institute of Medicine: Improving interpretive performance in mammography. Improving breast imaging quality standards. Edited by: Sharyl N, Ball J. 2005, Washington, D.C.: National Academy Press, 24-44.
Quality Assurance Guidelines for Radiologists. [http://www.cancerscreening.nhs.uk/breastscreen/publications/nhsbsp59.html]
Clark R: Re: Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2005, 97: 936.
Smart CR, Byrne C, Smith RA, Garfinkel L, Letton AH, Dodd GD, Beahrs OH: Twenty-year follow-up of the breast cancers diagnosed during the Breast Cancer Detection Demonstration Project. CA Cancer J Clin. 1997, 47 (3): 134-149.
Kerlikowske K, Grady D, Barclay J, Frankel SD, Ominsky SH, Sickles EA, Ernster V: Variability and accuracy in mammographic interpretation using the American College of Radiology Breast Imaging Reporting and Data System. J Natl Cancer Inst. 1998, 90 (23): 1801-1809. 10.1093/jnci/90.23.1801.
Smith-Bindman R, Ballard-Barbash R, Miglioretti DL, Patnick J, Kerlikowske K: Comparing the performance of mammography screening in the USA and the UK. J Med Screen. 2005, 12: 50-54. 10.1258/0969141053279130.
Yankaskas BC, Klabunde CN, Ancelle-Park R, Renner G, Wang H, Fracheboud J, Pou G, Bulliard JL: International comparison of performance measures for screening mammography: can it be done?. J Med Screen. 2004, 11: 187-193. 10.1258/0969141042467430.
Smith RA: Breast cancer screening. IARC handbooks of cancer prevention. Edited by: Vainio H, Bianchini F. 2002, Lyon: IARC Press, 2: 119-134.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/8/91/prepub