External Validation and Recalibration of a Mortality Prediction Model for Patients with Ischaemic Stroke

Abstract

Background: Stroke is a highly prevalent disease that can provoke severe disability. We evaluate a predictive model based on the Minimum Basic Data Set (MBDS) compiled by the Spain Health Ministry, obtained for the period 2008–2012 for patients with ischaemic stroke in Spain, to establish the model’s validity and to optimise its calibration. The MBDS is the main clinical-administrative database for hospitalisations recorded in Spain, and to our knowledge, no predictive models for stroke mortality have previously been developed using this resource. The main study aim is to perform an external validation and recalibration of the coefficients of this predictive model with respect to a chronologically later cohort. Material and Methods: External validation (testing the model on a different cohort to assess its performance) and recalibration (validation with optimisation of model coefficients) were performed using the MBDS for patients admitted for ischaemic stroke in the period 2016–2018. A cohort study was designed, in which a recalibrated model was obtained by applying the variables of the original model without their coefficients. The variables from the original model were then applied to the subsequent cohort, together with the coefficients from the initial model. The areas under the curve (AUC) of the recalibration and the external validation procedure were compared. Results: The recalibrated model produced an AUC of 0.743 and was composed of the following variables: age (odds ratio, OR:1.073), female sex (OR:1.143), ischaemic heart disease (OR:1.192), hypertension (OR:0.719), atrial fibrillation (OR:1.414), hyperlipidaemia (OR:0.652), heart failure (OR:2.133) and posterior circulation stroke (OR: 0.755). External validation produced an AUC of 0.726. Conclusions: The recalibrated clinical model thus obtained presented moderate-high discriminant ability and was generalisable to predict death for patients with ischaemic stroke. Rigorous external validation slightly decreased the AUC but confirmed the validity of the baseline model for the chronologically later cohort.