Derivation and Validation of a Machine Learning Model for the Prevention of Unplanned Dialysis

Abstract

Key Points Nearly half of all patients with CKD who progress to kidney failure initiate dialysis in an unplanned fashion, which is associated with poor outcomes.Machine learning models using routinely collected data can accurately predict 6- to 12-month kidney failure risk among the population with advanced CKD.These machine learning models retrospectively deliver advanced warning on a substantial proportion of unplanned dialysis events. Background Approximately half of all patients with advanced CKD who progress to kidney failure initiate dialysis in an unplanned fashion, which is associated with high morbidity, mortality, and health care costs. A novel prediction model designed to identify patients with advanced CKD who are at high risk for developing kidney failure over short time frames (6–12 months) may help reduce the rates of unplanned dialysis and improve the quality of transitions from CKD to kidney failure. Methods We performed a retrospective study using machine learning random forest algorithms incorporating routinely collected age and sex data along with time-varying trends in laboratory measurements to derive and validate 6- and 12-month kidney failure risk prediction models in the population with advanced CKD. The models were comprehensively characterized in three independent cohorts in Ontario, Canada—derived in a cohort of 1849 consecutive patients with advanced CKD (mean [SD] age 66 [15] years, eGFR 19 [7] ml/min per 1.73 m2) and validated in two external advanced CKD cohorts (n=1356; age 69 [14] years, eGFR 22 [7] ml/min per 1.73 m2). Results Across all cohorts, 55% of patients experienced kidney failure, of whom 35% involved unplanned dialysis. The 6- and 12-month models demonstrated excellent discrimination with area under the receiver operating characteristic curve of 0.88 (95% confidence interval [CI], 0.87 to 0.89) and 0.87 (95% CI, 0.86 to 0.87) along with high probabilistic accuracy with the Brier scores of 0.10 (95% CI, 0.09 to 0.10) and 0.14 (95% CI, 0.13 to 0.14), respectively. The models were also well calibrated and delivered timely alerts on a significant number of patients who ultimately initiated dialysis in an unplanned fashion. Similar results were found upon external validation testing. Conclusions These machine learning models using routinely collected patient data accurately predict near-future kidney failure risk among the population with advanced CKD and retrospectively deliver advanced warning on a substantial proportion of unplanned dialysis events. Optimal implementation strategies still need to be elucidated.