Use of Receiver Operating Characteristic Curves to Assess the Performance of a Microdilution Assay for Determination of Drug Susceptibility of Clinical Isolates of Mycobacterium tuberculosis
Tóm tắt
The aim of this study was to apply receiver operating characteristic (ROC) analysis to the microplate Alamar blue assay, a recently developed alternative for drug susceptibility testing of mycobacteria. As this is a quantitative assay, its performance can be determined by ROC analysis, in which the area under the ROC curve represents a summary of test performance (the higher the area, the better the test's performance). Sixty isolates of Mycobacterium tuberculosis were tested by the microcolorimetric assay against six twofold dilutions of streptomycin, isoniazid, rifampin, and ethambutol. For each isolate, the susceptibility pattern was simultaneously established by the agar proportion method, the result of which represented the gold standard value for the ROC analysis. The critical concentration, area under the curve, and P value for each drug were determined by ROC curve analysis. The results of the assay were obtained in an average of 8 days of incubation. The performance of the assay was excellent for all four drugs: the area under the curves was >0.97, the P values were 0.000, and sensitivity was 94%, specificity 97%, predictive value for resistance ≥92%, predictive value for susceptibility 97%, and test efficiency 97%. According to ROC analysis, the microplate Alamar blue assay is a reliable method for determination of drug-susceptibility. Rapidity and cost efficiency are two additional qualities that make this test an excellent alternative for the drug susceptibility testing of Mycobacterium tuberculosis. The ROC curve analysis is a robust statistical approach for evaluating the performance of new quantitative methods for determination of drug sensitivity of Mycobacterium tuberculosis isolates.
Tài liệu tham khảo
Cooksey RC, Crawford T, Jacobs WR, Shinnick TM (1993) A rapid method for screening antimicrobial agents for activities against a strain ofMycobacterium tuberculosis expressing firefly luciferase. Antimicrob Agents Chemother 37:1349–1352
Riska PF, Su Y, Bardarov S, Freundlich L, Sarkis G, Hatfull G, Carrière C, Kumar V, Chan J, Jacobs WR (1999) Rapid film-based determination of antibiotic susceptibilities ofMycobacterium tuberculosis by using a luciferase reporter phage and the Bronx Box. J Clin Microbiol 37:1144–1149
Walters SB, Hanna BA (1996) Testing of susceptibility ofMycobacterium tuberculosis to isoniazid and rifampin by Mycobacterium growth indicator tube method. J Clin Microbiol 34:1565–1567
Palomino JC, Traore H, Fissette K, Portaels F (1999) Evaluation of mycobacteria growth indicator tube (MGIT) for drug susceptibility testing ofMycobacterium tuberculosis. Int J Tuberc Lung Dis 3:344–348
Wagner M, Mills K (1996) Testing ofMycobacterium tuberculosis susceptibility to ethambutol, isoniazid, rifampin and streptomycin by using E test. J Clin Microbiol 34:1672–1676
Norden MA, Kurzynski TA, Bownds SE, Callister SM, Schell RF (1995) Rapid susceptibility testing ofMycobacterium tuberculosis (H37Ra) by flow cytometry. J Clin Microbiol 33:1231–1237
Moore AV, Kirk SM, Callister SM, Mazurek GH, Schell RF (1999) Safe determination of susceptibility ofMycobacterium tuberculosis to antimycobacterial agents by flow cytometry. J Clin Microbiol 37:479–483
Eltringham IJ, Wilson SM, Drobniewski FA (1999) Evaluation of a bacteriophage-based assay (phage amplified biologically assay) as a rapid screen for resistance to isoniazid, ethambutol, streptomycin, pyrazinamide and ciprofloxacin among clinical isolates of Mycobacterium tuberculosis. J Clin Microbiol 37:3528–3532
Gomez-Flores R, Gupta S, Tamez-Guerra R, Mehta RT (1995) Determination of MICs forMycobacterium avium-M. intracelullare complex in liquid medium by a colorimetric method. J Clin Microbiol 33:1842–1846
Mshana RN, Tadesse G, Abate G, Miörner H (1998) Use of 3(-4,5-dimethylthiazol-2-yl)-2,5-diphenyl tetrazolium bromide (MTT) for rapid detection of rifampicin-resistantMycobacterium tuberculosis. J Clin Micobiol 36:1214–1219
Yajko DM, Madej JJ, Lancaster MV, Sanders CA, Cawthon VL, Gee B, Babst A, Hadley WK (1995) Colorimetric method for determining MICs of antimicrobial agents for Mycobacterium tuberculosis. J Clin Microbiol 33:2324–2327
Collins LA, Franzblau SG (1997) Microplate Alamar blue assay versus BACTEC 460 system for high-throughput screening of compounds againstMycobacterium tuberculosis and Mycobacterium avium. Antimicrob Agents Chemother 41:1004–1009
Franzblau SG, Witzig RS, McLaughlin JC, Torres P, Madico G, Hernandez A, Degnan MT, Cook MB, Quenzer VK, Ferguson RM, Gilman RH (1998) Rapid, low-technology MIC determination with clinicalMycobacterium tuberculosis isolates by using the microplate Alamar blue assay. J Clin Microbiol 36:362–366
Ahmed SA, Gogal RM, Walsh JE (1994) A new rapid and simple non-radioactive assay to monitor and determine the proliferation of lymphocytes: an alternative to [3H] thymidine incorporation assay. J Immunol Methods 170:211–224
Pfaller MA, Vu Q, Lancaster M, Espinel-Ingroff A, Fothergill VL, Grant C, McGinnis MR, Pasarell L, Rinaldi MG, Steele-Moore L (1994) Multisite reproducibility of colorimetric broth microdilution method for antifungal susceptibility testing of yeast isolates. J Clin Microbiol 32:1625–1628
Griner PF, Mayewski RJ, Mushlin AI, Greenland P (1981) Selection and interpretation of diagnostic tests and procedures. Principles and applications. Ann Intern Med 94:557–592
Swets AJ (1988) Measuring the accuracy of diagnostic systems. Science 240:1285–1293
Dawson-Saunders B, Trapp RG (1994) Basic and clinical biostatistics. Appleton and Lange, Norwalk, CT, p 275
van der Schouw YT, Verbeek ALM, Rouijs SHJ (1995) Guidelines for the assessment of new diagnostics tests. Invest Radiol 30:334–340
Mitchell MF, Cantor SB, Brookner C, Utzinger U, Schottenfeld D, Richards-Kortum R (1999) Screening for squamous intraepithelial lesions with fluorescence spectroscopy. Obstet Gynecol 94:889–896
U.S. Food and Drug Administration, Center for Devices and Radiological Health (2001) Premarket applications for digital mammography systems; final guidance for industry and FDA. U.S. Food and Drug Administration, Washington DC, document no. 983
Inderlied CB, Salfinger M (1995) Antimicrobial agents and susceptibility tests: mycobacteria. In: Murray PR, Baron EJ, Pfaller MA, Tenover FC, Yolken RH (eds) Manual of clinical microbiology. American Society for Microbiology, Washington DC, pp 1385–1404
Rastogi N, Goh KS, David HL (1989) Drug susceptibility testing in tuberculosis: a comparison of the proportion methods using Löwenstein-Jensen, Middlebrook 7H10 and 7H11 agar media and a radiometric method. Res Microbiol 140:405–417
National Committee for Clinical Laboratory Standards (2000) Susceptibility testing of mycobacteria, nocardia and other aerobic actinomycetes. Tentative standard M24-T2, 2nd edn. NCCLS, Wayne, PA
Jorgensen JH (1993) Selection criteria for an antimicrobial susceptibility testing system. J Clin Microbiol 31:2841–2844
Jorgensen JH, Ferraro MJ (1998) Antimicrobial susceptibility testing: general principles and contemporary practices. Clin Infect Dis 26:973–980
Heifets L (2000) Conventional methods for antimycobacterial susceptibility testing of Mycobacterium tuberculosis. In: Bastian I, Portaels F (eds) Multidrug-resistant tuberculosis. Kluwer, Dordrecht, pp 133–144
Palomino JC, Portaels F (1999) Simple procedure for drug susceptibility testing of Mycobacterium tuberculosis using a commercial colorimetric assay. Eur J Clin Microbiol Infect Dis 18:380–383