Knowledge-Based Systems. Methods for Developing and Evaluating Expert Systems: Critiquing Physician Decision Making Using Data from Automated Medical Records: Assessing the Limitations

摘要

This paper describes the evaluation of a critiquing system, HYPERCRITIC, that relies on automated medical records for its data input. The purpose of HYPERCRITIC is to offer comments to general practitioners on their treatment of hypertension. HYPERCRITIC has access to the data stored in a primary-care information system that supports a fully automated medical record. Medical records of 20 patients with hypertension were submitted to both physicians and HYPERCRITIC. The critique generated by the physicians was subsequently compared to the critique generated by HYPERCRITIC. Of the 260 comments made by the majority of the physicians, 118 were also made by HYPERCRITIC. The reasons why HYPERCRITIC failed to reproduce the remaining 142 comments are evaluated.