The impact of Computer-assisted Test Interpretation on Physician Decision Making

Abstract

This research investigated the effect of computer-assisted test interpretation (CATI) on physicians' readings of electrocardiograms (ECGs). The authors used an experimental method based on direct observations of 22 cardiologists, each reading 80 ECGs, for a total of 1,760 (of which 1,745 were used in the study). There were 40 sets of clini cally-matched pairs of ECGs, one with CATI and one without. Reading time was ob served and interpretation accuracy was measured by criterion-referenced aggregate scoring. To control for potential biases, the findings were subjected to multivariate analyses using ordinary least-squares regressions. The impact of CATI on cardiolo gists' readings of ECGs is demonstrably beneficial: the main empirical conclusion of this study is that, compared with conventional interpretation, the use of computer- assisted interpretation of ECGs cuts physician time by an average of 28% and signif icantly improves the concordance of the physician's interpretation with the expert benchmark, without increasing the false-positive rate. Moreover, CATI is the most ac curate and saves the most time when the ECGs have many unambiguous diagnoses. Given that computers alone cannot perform the task of cardiovascular diagnosis, and that cardiologists' ECG interpretations are greatly enhanced by ubiquitous CATI tech nology, it appears that the best approach is one that combines person and machine. Key words: electrocardiogram interpretation; computer-assisted test interpretation; physician decision making; diagnostic concordance; technology utilization. (Med Decis Making 1997;17:80-86)