A methodology for evaluation of knowledge-based systems in medicine

Adams, 1986, Computer aided diagnosis of acute abdominal pain: A multi centre study, Brit. Med. J., 293, 800, 10.1136/bmj.293.6550.800 Adlassnig, 1985, Present state of medical expert systems — CADIAG 2, Meth. Inform. Med., 24, 13, 10.1055/s-0038-1635354 .^Bahill, 1987, Tools for extracting knowledge and validating expert systems, IEEE, 857 Barber, 1990, The six safety first principles of health information systems, computer perspectives in health care Brender, 1989, Watch the system: An opinion on user validation of computer based decision support systems in Clinical Medicine, 275 Brosnan, 1987, Decision support for assessment of thyroid function, Automedila, 8, 169 Fieschi, 1986, Some reflections on the evaluation of Expert Systems in Medicine, Meth. Inform. Med., 25, 15, 10.1055/s-0038-1636677 M.S. Fuji, Independent verification of highly reliable programs, Proc. COMPSAC 77, 38–44. Gaschnig, 1983, Evaluation of expert systems in building expert systems, 241 Gottinger, 1988, Technology assessment and forecasting of medical expert systems (MEST), Methods of Inf. Med., 27, 56 Green, 1987, Verification and validation of expert systems, 38 Kent, 1985, Improvements in data collection through physician use of a computer based chemotherapy treatment consultant, J. Clin. Oncol., 10, 1409, 10.1200/JCO.1985.3.10.1409 Kors, 1990, The Delphi Method to validate diagnostic knowledge in computerised ECG interpretation, Meth. Inform. Med., 29, 44, 10.1055/s-0038-1634766 Kulikowski, 1988, Medical expert systems: Issues of validation, evaluation and judgement in policy issues, 45 Miller, 1985, Evaluation of artificial intelligence systems in medicine, 281 Miller, 1982, INTERNIST-1, An experimental computer based diagnostic consultant for general internal medicine, New Eng. J. Med., 307, 468, 10.1056/NEJM198208193070803 Nolan, 1991, Factors influencing transferability of knowledge-based systems, Int. J. Biomed. Comp., 27, 7, 10.1016/0020-7101(91)90018-A 1990, 5 O'Moore, 1989, The evaluation of medical decision support/expert systems, 263 O'Moore, 1990, Items of relevance for the evaluation of knowledge based/expert systems and influence from domain characteristics, Report EM-1.1 of the KAVAS (A1021) AIM Project O'Moore, 1990, Methodology for evaluation of knowledge based systems, Technical Report EM-1.2 of the KAVAS (A1021) AIM Project Ramsey, 1986, A comparative analysis of methods for expert systems, Int. J. Man-Machine Studies, 24, 475, 10.1016/S0020-7373(86)80004-9 Rossi-Mori, 1988, On the assessment of medical expert systems, 36, 292 Smeets, 1990, General methodology and problems in assessment of decision support systems, 225 Sol, 1987, Paradoxes around DSS in decisions support systems: Theory and application, 3 Sørgaard, 1986, Evaluating expert system prototypes Suwa, 1985, Completeness and consistency in a rule based system Teach, 1981, An analysis of physician attitudes regarding computer based clinical consultation systems, Comp. Biomed. Res., 14, 542, 10.1016/0010-4809(81)90012-4 Wyatt, 1989, Evaluating medical expert systems: What to test and how, 274