Study Finds Most Readmission Prediction Models Perform Poorly

A review and analysis of 26 validated hospital readmission risk prediction models finds that most, whether for hospital comparison or clinical purposes, have poor predictive ability, according to an article in JAMA.

According to the background information in the article, an increasing body of literature has attempted to describe and validate hospital readmission risk prediction tools. Predicting hospital readmission risk is of great interest to identify which patients would benefit most from care transition interventions, as well as to risk-adjust readmission rates for the purposes of hospital comparison.

Devan Kansagara, MD, MCR, of Portland Veterans Affairs Medical Center and Oregon Health and Science University, Portland, and colleagues conducted a systematic review of studies on validated readmission risk prediction models to examine their performance and assess their suitability for clinical or administrative use. Of 7,843 citations reviewed, 30 studies of 26 unique models across a variety of settings and patient populations met the inclusion criteria. Total sample size ranged from 173 patients to more than 2.7 million patients.

Among the models, the outcome of 30-day readmission was reported most commonly, although some models used other follow-up intervals ranging from 14 days to 4 years. Fourteen models were based on retrospective administrative data and could potentially be used for hospital comparison purposes. Most of these included variables for medical comorbidity and use of prior medical services. Of these models, nine were tested in large US populations and had poor discriminative ability.

“Seven models could potentially be used to identify high-risk patients for intervention early during a hospitalization, and five could be used at hospital discharge,” Kansagara wrote. “Six studies compared different models in the same population and two of these found that functional and social variables improved model discrimination. Although most models incorporated variables for medical comorbidity and use of prior medical services, few examined variables associated with overall health and function, illness severity or social determinants of health.”

The authors added that more research is needed to assess the true preventability of readmissions in US health systems.

“Given the broad variety of factors that may contribute to preventable readmission risk, models that include factors obtained through medical record review or patient report may be valuable,” they wrote. “Innovations to collect broader variable types for inclusion in administrative data sets should be considered. Future studies should assess the relative contributions of different types of patient data (eg, psychosocial factors) to readmission risk prediction by comparing the performance of models with and without these variables in a given population. These models should ideally be based on population-specific conceptual frameworks of risk.”

Leave a Reply

Your email address will not be published.