- Open Access
Development of a prognostic nomogram for sepsis associated-acute respiratory failure patients on 30-day mortality in intensive care units: a retrospective cohort study
BMC Pulmonary Medicine volume 23, Article number: 43 (2023)
Acute respiratory failure is a type of sepsis complicated by severe organ failure. We have developed a new nomogram for predicting the 30-day risk of death in patients through a retrospective study.
Data was collected and extracted from MIMICIV, with 768 eligible cases randomly assigned to the primary cohort (540) and the validation cohort (228). The final six factors were included by Cox regression analysis to create the Nomogram, the accuracy of the Nomogram was assessed using the C-index and calibration curve, and finally, the clinical usefulness of the Nomogram was evaluated using DCA in.
Multivariate Cox regression analysis showed that age, DBP, lactate, PaO2, platelet, mechanical ventilation were independent factors for 30-day mortality of SA-ARF. The nomogram established based on the six factors. The C-index of nomogram in the primary cohort is 0.731 (95% CI 0.657–0.724) and 0.722 (95%CI 0.622–0.759) in the validation cohort. Besides, the decision curve analysis (DCA) confirmed the clinical usefulness of the nomogram.
The study developed and validated a risk prediction model for SA-ARF patients that can help clinicians reasonably determine disease risk and further confirm its clinical utility using internal validation.
Sepsis is a lethal syndrome of physiologic, pathologic, and biochemical abnormalities induced by infection, one of the major global public health concerns . Although extensive research has recently demonstrated the mechanism and treatment of sepsis, sepsis is still the principal cause of death in intensive care patients worldwide . For the evaluation of organ dysfunction or failure, there is currently the Sequential Organ Failure Assessment (SOFA) or Quick Sequential Organ Failure Assessment (qSOFA), which does not include pulmonary function other than with a respiratory rate . Patients might be impacted with acute respiratory failure (ARF) if they fulfilled either diagnostic criteria. Notably, early diagnosis and treatment can help reduce mortality.
Therefore, acute respiratory failure was the common sepsis-associated organ injury resulting in critical mortality [4,5,6]. ARF is due to severe dysfunction of pulmonary ventilation. Moreover, a decrease in the arterial partial pressure of oxygen (PaO2) is a sign of pulmonary dysfunction in patients with sepsis . According to accumulating studies, acute respiratory failure had a 60% mortality rate in the ICU, an average hospital stay is 7.1 days, and related medical costs are up to US$54 billion annually in the USA [8, 9]. Clinical risk factors, pathobiology, response to treatment, and elements of pulmonary recovery have been extensively studied, which has improved the prevention, detection, and treatment of acute respiratory with sepsis [10, 11].
Nevertheless, the pathogenesis of sepsis-related acute respiratory failure is still in an ongoing phase of exploration, and the different sources of risk factors make it a significant clinical challenge for early detection . In recent studies, the disease characteristics of SA-ARF patients have been used to identify increased risks. However, most of them have not combined these with clinical prediction models [13, 14]. Nevertheless, few studies have focused on patients with sepsis complicated by ARF. Thus, the purpose of this study by an extensive clinical database is to evaluate the impact of SA-ARF on the 30-day mortality and to develop a predictive nomogram for predicting the probability of 30-day mortality in patients with SA-ARF.
This retrospective study was based on the MIMIC IV (V1.0) database, a large intensive care database. Which contains comprehensive information for each patient while they were in the hospital: laboratory measurements, medications administered, vital signs documented, and so on. It is intended to support a wide variety of research in healthcare . MIMIC-IV builds upon the success of MIMIC-III and incorporates numerous improvements over MIMIC-III. Informed consent for this study has been waived by the Massachusetts Institute of Technology and Beth Israel Deaconess Medical Center. The author has the right to use and download the database through the Protecting Human Research Participants exam.
We included patients aged > 18 years with a diagnosis of sepsis according to the International Classification of Diseases, Ninth Revision (ICD-9). Also, the MIMIC-IV database was used to identify patients with ARF based on their ICD-9 code. For patients with multiple ICU admissions, only the first ICU admission for each patient was analyzed. Patients with ARF before admission to the ICU were excluded. The cohort is randomly split into the primary cohort and the verification cohort according to the ratio of 7:3 (Fig. 1). The primary cohort is used to establish the nomogram, and the verification queue is used for verification.
PgAdmin4 has used run structure query language (SQL) and extracted data from the MIMIC IV database. The following variables were extracted or calculated: (1) basic demographics including age, gender and private insurance, (2) vital signs, including heart rate, mean arterial pressure (MAP), systolic blood pressure (SBP), diastolic blood pressure (DBP) and (3) laboratory parameters, including white blood cell, hemoglobin, platelet, albumin, bilirubin, potassium, sodium, bicarbonate, lactate, creatinine, blood urea nitrogen, partial pressure of oxygen, etc. severity score, mechanical ventilation, length of ICU, hospital stay, and date of death, etc. All the data were extracted from the data generated within the first 24 h after the patient entered the ICU (i.e., the baseline value). All the scripts used to calculate the SOFA and SAPSSII scores were available from the GitHub website (https://github.com/MIT-LCP/mimic-code/tree/main/mimic-iv/concepts).
Continuous variables were presented as median, and categorical variables were presented as a number. Categorical variables between the groups were compared using the X2 test and Fisher exact test. The object of this study was to develop a prognostic model for 30-day mortality of patients in ARF with sepsis in the ICU. Therefore, we used the Cox proportional hazard model. Univariate Cox regression was used to analyze the relationships of relevant variables with these patients. Variables with P < 0.05 in univariate analysis were further included in the multivariate Cox proportional hazard model. The HR, which was used to approximate the risk of an event, was also calculated. The backward stepwise process based on the Akaike information criterion was used to control the overfitting of the model.
Establish a nomogram model based on the above analysis results. Moreover, the C-index and calibration are often considered the essential property of a model. Normally, the C-index used to determine a nomogram's discrimination, which was 0.5, would not have an event. If the model always produces a higher probability of patients having events than those not, the C-index is 1.0 . The calibration curve is often considered an essential property of a model and reflects the extent to which a model correctly estimates the absolute risk. Poorly calibrated models will underestimate or overestimate the outcome of interest . Decision curve was a new method to evaluate the prognostic nomogram by quantifying the standardized net benefits at different threshold probabilities. In our study, a P value < 0.05 was considered statistically significant. All analyses were performed using Stata 16 and R software (R v4.1.1).
Population and baseline characteristics
A total of 2057 patients with sepsis 3.0 and 768 patients positively tested for SA-ARF in the MIMIC IV database were included which have complete data within 24 h after ICU admission. The mean age of patients was 68 years old and males accounted for 56.51%. Patients were randomly devided to primary cohort (540 patients) and validation cohort (228 patients). There were no significant differences in baseline characteristics between the two cohorts (P > 0.05). All baseline characteristics are summarized in Table 1.
Prognostic factors in the primary cohort
By applying the COX regression model to univariate prognostic analysis, a stepwise regression approach was used. Variables, including age, lactate, bicarbonate, bilirubin, heart rate, platelets, Pao2 level, DBP, chronic heart failure and mechanical ventilation, were potential predictors of 30-day mortality in the univariate analysis (p < 0.05) (Table 2). After adjusting for these variables, all these candidate factors were included the multivariable Cox proportional hazard model. At last, six factors were included in the final prediction model (P < 0.05) (Table 3).
Development of a prediction nomogram
A nomogram for predicting the 30-day survival was constructed with the six variables that had most significant values in multivariate Cox proportional hazards regression (Fig. 2).
The nomogram was established to standardize the regression coefficients (HR values), and then display them as risk scores on the number line. To use the nomogram, first judge the scores for each factor, then add up the total scores and finally draw a vertical line from the total points line down to the straight 30-day survival line. This gives an estimate of the probability of 30-day survival.
For instance, a patient with sepsis and respiratory failure was 55 years old (30 points), a lactate level of 3 mmol/L (15 points),without ventilation, platelet with 50 K/uL (40 points), DBP with 80 mmHg (20 points), Pao2 level of 150 (25 points), had a total score of 130 points and the 30-day survival probability was 40%.
Validation of the prediction nomogram
Using the 1000 bootstrap resampling method, the performance of the prediction nomogram was internally validated in the validation set. The calibration curve of the nomogram for the prediction of 30-day survival in sepsis patients demonstrated good agreement both in the primary cohort and validation cohort (Fig. 3a, b). Moreover, the C-index for the prediction nomogram was 0.731 (95% CI 0.657–0.724) for the primary cohort and 0.722 (95%CI 0.622–0.759) for the validation cohort.
Clinical use of the nomogram
Finally, the decision curve analysis (DCA) was used to confirm the findings. The analysis of the decision curve showed that in the primary cohort and in the validation cohort, the threshold probability of our nomogram is 0.92 in the primary cohort and 0.85 in the validation cohort (Fig. 4a, b). Within this range, the predictive effect of the nomogram is better than that of a single predictor, respectively.
This retrospective analysis study extracted clinical data from an extensive database named MIMIC IV, which has more than 500,000 medical records from 2008 to 2019. Using Cox regression models, we conducted the risk factors related to 30-day mortality of ARF with sepsis, which included age, DBP, lactate, bilirubin, Pao2, SAPS II, CHF, and the use of mechanical ventilation. We established a prognostic nomogram for these patients in the ICU. The nomogram can be used to predict and diagnose. As far as we know, this is the first study to evaluate the risk factors associated with 30-day mortality about ARF with sepsis in the ICU and establish a nomogram.
An inflammatory response, immune suppression, and oxidative stress led to sepsis. Moreover, the effects of an inappropriate response to this infection resulted in impaired cellular function, mitochondrial dysfunction, and ultimately acute respiratory failure . Although the mechanisms by which sepsis leads to respiratory failure are still unclear, the development of these mechanisms can be balanced with the variables in our model [19, 20]. Therefore, this model may have important implications for the development of acute respiratory failure in sepsis.
Acute respiratory failure is a common complication in patients with sepsis. Early diagnosis of ARF is usually confirmed by clinical manifestations, radiographs, CT, and pulmonary function, which are cumbersome operational steps . In recent years ultrasound technology has also played an essential role in diagnosing ARF patients in the ICU . What is more, sepsis is usually diagnosed by SOFA score or qsofa score . However, few studies have mentioned association between ARF and short-term mortality in sepsis. Based on this, it is vital for clinicians to conduct a thorough evaluation of the risk of death from sepsis and to objectively estimate the risks and benefits of medical interventions so that patients and families can make medical decisions with a careful assessment of the impact of potential treatment options. This will not only prevent medical disputes but also reduce certain medical costs. Thus, prediction nomograms are crucial for improving the risk stratification process of sepsis and can be used by clinicians to provide clear, accurate information to families of patients with SA-ARF. Therefore our nomogram used six factors that were easily accessible and could be collected on the first day of admission. We hope that this chart will enable us to identify sepsis with acute respiratory failure quickly.
Our study's initial vital signs include diastolic blood pressured and PaO2, which were considered an independent risk factor for patients with acute respiratory failure in SA-ARFs, the same result as the previous study . Age was widely recognized as the most powerful risk factor for organ failure in ICU. Increasing age was a major determinant of organ failure and overall mortality [25, 26]. A large cohort study proved that patients who died with sepsis also tended to be older adults . In summary, age is strongly associated with poor prognosis in patients with acute respiratory failure in sepsis. Lactate was more dominant in the nomogram, which was the most significant predictor of mortality at 30 days in patients with sepsis-associated acute respiratory failure. Lactate levels can indicate the severity of the underlying disease. Moreover, it has been shown that elevated lactate levels may predict death in critically ill patients, while reduced lactate levels have been reported to be associated with improved clinical outcomes [28, 29]. Jean-Louis Vincent et al. indicated that lactate levels are associated with prognosis in sepsis and acute respiratory failure patients [30, 31]. Consistently, our study found that lactate is an Independent predictor for 30-day mortality of SA-ARF. In one sense, sepsis can be seen as a race to the death between the pathogens and the host immune system. The exaggerated response can lead to multi-organ failure (MOF), especially respiratory failure. As we all know, the interaction of platelets with immune cells and endothelial cells is an anti-infective response.
Nevertheless, during sepsis, the mechanisms become dysregulated and contribute to organ damage . One experiment proved that thrombocytopenia exacerbated the inflammatory response to sepsis and increased mortality . These experimental results are consistent with the results of our study. Besides, during sepsis, most patients require ventilation therapy. According to a randomized clinical trial, mechanical ventilation and conservative oxygen therapy are associated with poor outcomes in patients with sepsis . In short, these six factors are all predictors of mortality in respiratory failure. They are all clinically accessible nomograms that have been widely used in cancer research, and are increasingly being utilized in the prediction of diseases [35, 36]. The nomogram was developed to survive acute respiratory failure in the elderly at 28 days, 60 days, and one year . For the mortality of SA-ARF, our study is the first to propose a simple nomogram to predict its mortality. The six included predictors were readily available on the first day of ICU admission. Furthermore, following calibration by internal validation to the actual 30-day mortality, we found high agreement between the training set and the validation set. In this cohort, the C-index was more than 0.7, and the calibration analysis performed in two cohorts revealed that the predicted 30-day mortality was similar. In addition, all decision curves in the cohort have net benefit rates above 50 percent.
Furthermore, there are two points to consider when using the nomogram. In our study, vital signs are calculated based on the average of each ICU patient's first 24 h in the ICU. Accordingly, the nomogram is not relevant to patients who die within 24 h of admission or who leave the intensive care unit within 24 h. In addition, laboratory tests included in the nomogram are the first results to be obtained from the ICU; consequently, all the laboratory tests included in the nomogram should be finished within 24 h of admission to the ICU.
The paper has some limitations despite these inspiring findings. First, this retrospective study returned the necessary recall bias, so more prospective studies need to be done to confirm this further. Second, since the values for vital signs and laboratory tests are for the first 24 h of admission to the ICU, the model does not apply to patients who die within 24 h of admission to the ICU. Third, with regard to data processing, we discarded variables with missing values greater than 40%; the retained variables were then supplemented by means of interpolation, multiple interpolation, and model predictions. In this way, the results of the analysis may have been biased, and the C-index may have been less accurate. Finally, we have only performed internal validation, so a larger sample size is needed to demonstrate its feasibility.
With our nomogram based on the patients' age, lactate, platelets, DBP, Pao2 together with mechanical ventilation, we can predict 30-day mortality in SA-ARF easily. Which helps clinicians make risk based decisions and treatment strategies. However, we need further validation studies on larger sample size and the noninclusion of patients discharged from ICU before 24 h.
Availability of data and materials
All data generated or analyzed during this study are included in this published article.
Sepsis associated-acute respiratory failure
Acute respiratory failure
Medical Information Mart for Intensive Care IV
Beth Israel Deaconess Medical Center
Intensive care units
Decision curve analysis
Diastolic blood pressure
Alveolar oxygen partial pressure
Sequential organ failure assessment
Quick sequential organ failure assessment score
- SAPS II:
Simplified acute physiology score II
Mean arterial pressure
Systolic blood pressure
Alveolar oxygen partial pressure
Percutaneous oxygen saturation
Blood urea nitrogen
White blood cell
Chronic heart failure
Rhodes A, Evans LE, Alhazzani W, et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock: 2016. Intensive Care Med. 2017;43(3):304–77.
Kadri SS, Rhee C, Strich JR, et al. Estimating ten-year trends in septic shock incidence and mortality in United States Academic Medical Centers using clinical data. Chest. 2017;151(2):278–85.
Singer M, Deutschman CS, Seymour CW, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. 2016;315(8):801–10.
Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29(7):1303–10.
Cochi SE, Kempker JA, Annangi S, Kramer MR, Martin GS. Mortality trends of acute respiratory distress syndrome in the United States from 1999 to 2013. Ann Am Thorac Soc. 2016;13(10):1742–51.
Fowler 3rd AA, Truwit JD, Hite RD, et al. Effect of Vitamin C infusion on organ failure and biomarkers of inflammation and vascular injury in patients with sepsis and severe acute respiratory failure: the CITRIS-ALI randomized clinical trial [published correction appears in JAMA. 2020 Jan 28;323(4):379]. JAMA. 2019;322(13):1261–70.
Lelubre C, Vincent JL. Mechanisms and treatment of organ failure in sepsis. Nat Rev Nephrol. 2018;14(7):417–27.
Walkey AJ, Wiener RS. Use of noninvasive ventilation in patients with acute respiratory failure, 2000–2009: a population-based study. Ann Am Thorac Soc. 2013;10(1):10–7.
Vincent JL, Akça S, De Mendonça A, et al. The epidemiology of acute respiratory failure in critically ill patients(*). Chest. 2002;121(5):1602–9.
Moore S, Weiss B, Pascual JL, Kaplan LJ. Management of acute respiratory failure in the patient with sepsis or septic shock. Surg Infect (Larchmt). 2018;19(2):191–201.
American Thoracic Society and Infectious Disease Society of America. Guidelines for the management of adults with hospital-acquired, ventilator-associated, and healthcare-associated pneumonia. Am J Respir Crit Care Med. 2005;171:388–416.
Gunst J. Recovery from critical illness-induced organ failure: the role of autophagy. Crit Care. 2017;21(1):209.
Topol EJ. Deep learning detects impending organ injury in the clinic. Nature. 2019;572(7767):36–7.
Zhang W, Wang Y, Wang J, Wang S. Association between red blood cell distribution width and long-term mortality in acute respiratory failure patients. Sci Rep. 2020;10(1):21185.
Johnson A, Bulgarelli L, Pollard T, Horng S, Celi LA, Mark R. MIMIC-IV (version 0.4). PhysioNet 2020.
Lu Y, Guo H, Chen X, Zhang Q. Association between lactate/albumin ratio and all-cause mortality in patients with acute respiratory failure: a retrospective analysis. PLoS ONE. 2021;16(8):e0255744.
Gerds TA, Cai T, Schumacher M. The performance of risk prediction models. Biom J. 2008;50(4):457–79.
Alba AC, Agoritsas T, Walsh M, et al. Discrimination and calibration of clinical prediction models: users’ guides to the medical literature. JAMA. 2017;318(14):1377–84.
van der Poll T, van de Veerdonk FL, Scicluna BP, Netea MG. The immunopathology of sepsis and potential therapeutic targets. Nat Rev Immunol. 2017;17(7):407–20.
Iwashyna TJ, Ely EW, Smith DM, Langa KM. Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA. 2010;304(16):1787–94.
Wilson RS, Pontoppidan H. Acute respiratory failure: diagnostic and therapeutic criteria. Crit Care Med. 1974;2(6):293–304.
Wallbridge P, Steinfort D, Tay TR, Irving L, Hew M. Diagnostic chest ultrasound for acute respiratory failure. Respir Med. 2018;141:26–36.
Cecconi M, Evans L, Levy M, Rhodes A. Sepsis and septic shock. Lancet. 2018;392(10141):75–87.
Xu J, Weng J, Yang J, et al. Development and validation of a nomogram to predict the mortality risk in elderly patients with ARF. PeerJ. 2021;9:e11016.
Pedersen PB, Henriksen DP, Brabrand M, Lassen AT. Prevalence of organ failure and mortality among patients in the emergency department: a population-based cohort study. BMJ Open. 2019;9(10):e032692.
Tran DD, Groeneveld AB, van der Meulen J, Nauta JJ, Strack van Schijndel RJ, Thijs LG. Age, chronic disease, sepsis, organ system failure, and mortality in a medical intensive care unit. Crit Care Med. 1990;18(5):474–9.
Rhee C, Jones TM, Hamad Y, et al. Prevalence, underlying causes, and preventability of sepsis-associated mortality in US acute care hospitals. JAMA Netw Open. 2019;2(2):e187571.
Ryoo SM, Lee J, Lee YS, et al. Lactate level versus lactate clearance for predicting mortality in patients with septic shock defined by sepsis-3. Crit Care Med. 2018;46(6):e489–95.
Haas SA, Lange T, Saugel B, et al. Severe hyperlactatemia, lactate clearance and mortality in unselected critically ill patients. Intensive Care Med. 2016;42(2):202–10.
Nguyen HB, Rivers EP, Knoblich BP, et al. Early lactate clearance is associated with improved outcome in severe sepsis and septic shock. Crit Care Med. 2004;32(8):1637–42.
Vincent JL, Quintairos E Silva A, Couto L Jr, Taccone FS. The value of blood lactate kinetics in critically ill patients: a systematic review. Crit Care. 2016;20(1):257.
Singer M. The role of mitochondrial dysfunction in sepsis-induced multi-organ failure. Virulence. 2014;5(1):66–72.
de Stoppelaar SF, van’t Veer C, Claushuis TA, Albersen BJ, Roelofs JJ, van der Poll T. Thrombocytopenia impairs host defense in gram-negative pneumonia-derived sepsis in mice. Blood. 2014;124(25):3781–90.
Young P, Mackle D, Bellomo R, et al. Conservative oxygen therapy for mechanically ventilated adults with sepsis: a post hoc analysis of data from the intensive care unit randomized trial comparing two approaches to oxygen therapy (ICU-ROX). Intensive Care Med. 2020;46(1):17–26.
Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26(8):1364–70.
Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173–80.
Hsu CH, Hung YM, Chu KA, Chen CF, Yin CH, Lee CC. Prognostic nomogram for elderly patients with acute respiratory failure receiving invasive mechanical ventilation: a nationwide population-based cohort study in Taiwan. Sci Rep. 2020;10(1):13161.
This study was supported by [the Chengdu Science and Technology Bureau (No. 2017FZ0058)] and [the Health Department of Sichuan Province (No. 17PJ474)].
Ethical approval and consent to participate
The establishment of MIMIC-IV was approved by the institutional review boards of the Beth Israel Deaconess Medical Center (Boston, MA) and Massachusetts Institute of Technology (Cambridge, MA), thus, this study was granted a waiver of informed consent. All methods were performed in accordance with the relevant guidelines and regulations. Besides, this study was also approved by the Ethical Committee of The Chengdu Third People's Hospital, granted a waiver of informed consent (Additional attachments have been submitted).
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Luo, M., He, Q. Development of a prognostic nomogram for sepsis associated-acute respiratory failure patients on 30-day mortality in intensive care units: a retrospective cohort study. BMC Pulm Med 23, 43 (2023). https://doi.org/10.1186/s12890-022-02302-6
- Sepsis associated-acute respiratory failure
- Intensive care unit