The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews

BMC Medical Research Methodology - Tập 3 - Trang 1-13 - 2003
Penny Whiting1, Anne WS Rutjes2, Johannes B Reitsma2, Patrick MM Bossuyt2, Jos Kleijnen1
1Centre for Reviews and Dissemination, University of York, England, UK
2Department of Clinical Epidemiology and Biostatistics, Academic Medical Center, University of Amsterdam, The Netherlands

Tóm tắt

In the era of evidence based medicine, with systematic reviews as its cornerstone, adequate quality assessment tools should be available. There is currently a lack of a systematically developed and evaluated tool for the assessment of diagnostic accuracy studies. The aim of this project was to combine empirical evidence and expert opinion in a formal consensus method to develop a tool to be used in systematic reviews to assess the quality of primary studies of diagnostic accuracy. We conducted a Delphi procedure to develop the quality assessment tool by refining an initial list of items. Members of the Delphi panel were experts in the area of diagnostic research. The results of three previously conducted reviews of the diagnostic literature were used to generate a list of potential items for inclusion in the tool and to provide an evidence base upon which to develop the tool. A total of nine experts in the field of diagnostics took part in the Delphi procedure. The Delphi procedure consisted of four rounds, after which agreement was reached on the items to be included in the tool which we have called QUADAS. The initial list of 28 items was reduced to fourteen items in the final tool. Items included covered patient spectrum, reference standard, disease progression bias, verification bias, review bias, clinical review bias, incorporation bias, test execution, study withdrawals, and indeterminate results. The QUADAS tool is presented together with guidelines for scoring each of the items included in the tool. This project has produced an evidence based quality assessment tool to be used in systematic reviews of diagnostic accuracy studies. Further work to determine the usability and validity of the tool continues.

Tài liệu tham khảo

Glasziou P, Irwig L, Bain C, Colditz G: Systematic reviews in health care: A practical guide. Cambridge: Cambridge University Press. 2001 Deeks J: Systematic reviews of evaluations of diagnostic and screening tests. In: Systematic Reviews in Health Care: Meta-analysis in context. Edited by: Egger M, Davey Smith G, Altman D. 2001, London: BMJ Publishing Group, Second edition Whiting P, Rutjes A, Dinnes J, Reitsma JB, Bossuyt P, Kleijnen J: A systematic review of existing quality assessment tools used to assess the quality of diagnostic research. submitted Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press. 1995 Jadad AR, Moore A, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomised clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4. Juni P, Altman DG, Egger M: Assessing the quality of controlled trials. BMJ. 2001, 323: 42-46. 10.1136/bmj.323.7303.42. Juni P, Witschi A, Bloch RM, Egger M: The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999, 282: 1054-1060. 10.1001/jama.282.11.1054. Greenland S: Invited Commentary: A critical look at some popular meta-analytic methods. A J Epidemiol. 1994, 140: 290-296. Whiting P, Dinnes J, Rutjes AWS, Reitsma JB, M BP, Kleijnen J: A systematic review of how quality assessment has been handled in systematic reviews of diagnostic tests. submitted Whiting P, Rutjes AWS, Dinnes J, Reitsma JB, Bossuyt PMM, Kleijnen J: The development and validation of methods for assessing the quality and reporting of diagnostic studies. Health Technol Assess. Whiting P, Rutjes AWS, Reitsma JB, Glas A, Bossuyt PM, Kleijnen J: A systematic review of sources of variation and bias in studies of diagnostic accuracy. Ann Intern Med, In press. Kerr M: The Delphi Process. The Delphi Process 2002. 2001, City: Remote and Rural Areas Research Initiative, NHS in Scotland, avaliable online at http://www.rararibids.org.uk/documents/bid79-delphi.htm The Delphi Technique in Pain Research. The Delphi Technique in Pain Research. 2001, City: Scottish Network for Chronic Pain Research, 2002: avaliable at http://www.sncpr.org.uk/delphi.htm Bossuyt P, Reitsma J, Bruns D, Gatsonis C, Glasziou P, Irwig L, Moher D, Rennie D, de Vet H, Lijmer J: The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem. 2003, 49: 7-18. 10.1373/49.1.7. Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273: 408-412. 10.1001/jama.273.5.408. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/3/25/prepub