A trigger tool fails to identify serious errors and adverse events in pediatric otolaryngology

Abstract

OBJECTIVE: To identify and quantify errors and adverse events on an inpatient academic tertiary-care pediatric otolaryngology service, a trigger tool was developed and validated as part of a quality improvement initiative. STUDY DESIGN: Retrospective record review. SETTING: Children's Hospital Boston quality improvement initiative. SUBJECTS AND METHODS: Fifty inpatient admissions were reviewed. The gold standard for errors and adverse events identification was a detailed chart review by two board-certified otolaryngologists blinded to trigger tool findings. RESULTS: Trigger tool interrater reliability ranged from poor to high for admission triggers (kappa = 0.35, 95% confidence interval [95% CI] —0.07 to 0.76), discharge triggers (kappa = 0.63, 95% CI 0.27–0.99), medical records triggers (kappa = 0.61, 95% CI 0.11–1.00), and medication triggers (kappa = 0.90, 95% CI 0.71–1.00). Errors and adverse events were found in all admissions: three percent were potentially harmful, and 93 percent were documentation-related. CONCLUSION: The trigger tool was successful in identifying clerical and administrative errors and adverse events but failed to identify complex errors and adverse events. A hybrid approach for chart review may be cost-effective in pediatric otolaryngology.