An Immediate Mortality Prediction Score That is Robust to Missing Data
- 1 Department of Neurology, Massachusetts General Hospital (MGH), Boston, MA, USA
- 2 Department of Neurology, Massachusetts General Hospital (MGH), Boston, MA, USA
- 3 Clinical Data Animation Center (CDAC), Harvard Medical School, Boston, MA, USA
- 4 Department of Neurology, Massachusetts General Hospital (MGH), Boston, MA, USA
- 5 Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA
Abstract
Objective: To develop an illness severity score that predicts short-term mortality, based on a small number of readily available measurements, and overcomes limitations of the SOFA score, for use in research involving large-scale electronic health records. Design: Retrospective analysis of electronic records for 37,739 adult inpatients. Setting: A single tertiary care hospital system from 2016-2022. Patients: 37,739 adult ICU patients. Interventions: IMPS was developed using logistic regression with the 6 SOFA components, age, sex and missingness indicators as predictors, and 10-day mortality as the outcome. This was compared with SOFA with median imputation. Measurements and Main Results: Discrimination was evaluated by AUROC, calibration by comparing predicted and observed mortality. IMPS showed excellent discrimination (AUROC 0.80) and calibration. It outperformed SOFA alone (AUROC 0.70) and with age/sex (0.74). Conclusions: By retaining continuous data, adding age, allowing for missingness, and optimizing weights based on empirical mortality association, IMPS achieved substantially better mortality prediction than the original SOFA.
- Vincent, J.-L., Moreno, R., Takala, J., Willatts, S., de Mendonça, A., Bruining, H., et al . (1996) The SOFA (Sepsis-Related Organ Failure Assessment) Score to Describe Organ Dysfunction/Failure. Intensive Care Medicine , 22, 707-710. https://doi.org/10.1007/bf01709751
- Lambden, S., Laterre, P.F., Levy, M.M. and Francois, B. (2019) The SOFA Score—Development, Utility and Challenges of Accurate Assessment in Clinical Trials. Critical Care , 23, Article No. 374. https://doi.org/10.1186/s13054-019-2663-7
- Singer, M., Deutschman, C.S., Seymour, C.W., Shankar-Hari, M., Annane, D., Bauer, M., et al . (2016) The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). J ournal of the A merican M edical A ssociation , 315, 801-810. https://doi.org/10.1001/jama.2016.0287
- Vincent, J., de Mendonca, A., Cantraine, F., Moreno, R., Takala, J., Suter, P.M., et al . (1998) Use of the SOFA Score to Assess the Incidence of Organ Dysfunction/Failure in Intensive Care Units. Critical Care Medicine , 26, 1793-1800. https://doi.org/10.1097/00003246-199811000-00016
- Brinton, D.L., Ford, D.W., Martin, R.H., Simpson, K.N., Goodwin, A.J. and Simpson, A.N. (2022) Missing Data Methods for Intensive Care Unit SOFA Scores in Electronic Health Records Studies: Results from a Monte Carlo Simulation. Journal of Comparative Effectiveness Research , 11, 47-56. https://doi.org/10.2217/cer-2021-0079
- Neto, A.S. (2016) Epidemiological Characteristics, Practice of Ventilation, and Clinical Outcome in Patients at Risk of Acute Respiratory Distress Syndrome in Intensive Care Units from 16 Countries (PRoVENT): An International, Multicentre, Prospective Study. The Lancet Respiratory Medicine , 4, 882-893.
- Ferreira, F.L. (2001) Serial Evaluation of the SOFA Score to Predict Outcome in Critically Ill Patients. J ournal of the A merican M edical A ssociation , 286, 1754-1758. https://doi.org/10.1001/jama.286.14.1754
- Braasch, M.C., Halimeh, B.N. and Guidry, C.A. (2022) Availability of Multiple Organ Failure Score Components in Surgical Patients. Surgical Infections , 23, 178-182. https://doi.org/10.1089/sur.2021.265
- Vasilevskis, E.E., Pandharipande, P.P., Graves, A.J., Shintani, A., Tsuruta, R., Ely, E.W., et al . (2016) Validity of a Modified Sequential Organ Failure Assessment Score Using the Richmond Agitation-Sedation Scale. Critical Care Medicine , 44, 138-146. https://doi.org/10.1097/ccm.0000000000001375
- Alba, A.C., Agoritsas, T., Walsh, M., Hanna, S., Iorio, A., Devereaux, P.J., et al . (2017) Discrimination and Calibration of Clinical Prediction Models. J ournal of the A merican M edical A ssociation , 318, 1377-1384. https://doi.org/10.1001/jama.2017.12126