- Research article
- Open Access
Observation management of pulmonary embolism and agreement with claims-based and clinical risk stratification criteria in United States patients: a retrospective analysis
BMC Pulmonary Medicine volume 17, Article number: 37 (2017)
Guidelines suggest observation stays are appropriate for pulmonary embolism (PE) patients at low-risk for early mortality. We sought to assess agreement between United States (US) observation management of PE and claims-based and clinical risk stratification criteria.
Using US Premier data from 11/2012 to 3/2015, we identified adult observation stay patients with a primary diagnosis of PE, ≥1 PE diagnostic test claim and evidence of PE treatment. The proportion of patients at high-risk was assessed using the In-hospital Mortality for PulmonAry embolism using Claims daTa (IMPACT) equation and high-risk characteristics (age > 80 years, heart failure, chronic lung disease, renal or liver disease, high-risk for bleeding, cancer or need for thrombolysis/embolectomy).
We identified 1633 PE patients managed through an observation stay. Despite their observation status, IMPACT classified 46.4% as high-risk for early mortality and 33.3% had ≥1 high-risk characteristic. Co-morbid heart failure, renal or liver disease, high-risk for major bleeding, cancer and hemodynamic instability were low (each <4.5%), but 7.8% were >80 years-of-age and 19.4% had chronic lung disease.
Many PE patients selected for management in observation stay units appeared to have clinical characteristics suggestive of higher-risk for mortality based upon published claims-based and clinical risk stratification criteria.
Current guidelines suggest low-risk pulmonary embolism (PE) patients are candidates for treatment at home or with an abbreviated hospital stay versus ~5+ days of in-hospital management . Prior studies suggest up to 50% of PE patients may be treated in such a fashion .
In the United States (US), observation stays are intended to manage patients for short periods to determine appropriateness for inpatient admission, with the determination of admission/discharge occurring within 2-midnights. Observation stays may serve as an alternative to inpatient management for low-risk PE patients. Reimbursement policy changes have led to an increasing use of observation stays [3–6]. We assessed agreement between observation management of PE and claims-based and clinical risk stratification criteria using administrative claims data.
We performed a retrospective analysis using Premier claims data from 11/2012 to 3/2015. Premier captures ~20% of all discharges from US acute care hospitals. This study was performed in accordance with the Declaration of Helsinki. All data included in the Premier Perspective Comparative Hospital Database are de-identified and are in compliance with the Health Insurance Portability and Accountability Act (HIPAA) of 1996 to preserve participant anonymity and confidentiality. For this reason, this study was exempt from institutional review board oversight and did not require an approval by an ethics committee. The data used in this study was under license from Premier Inc. and provided through the study sponsor, Janssen Scientific Affairs, LLC.
To be included, adult patients had to have undergone an observation stay (self-reported by hospitals) with an International Classification of Diseases, 9th-revision (ICD-9) diagnosis code for PE (415.1x) in the primary position, have a claim for ≥1 diagnostic test for PE on day 0–2 (computed tomography, ventilation-perfusion scan, pulmonary angiography) and received pharmacologic (anticoagulation, thrombolysis) and/or non-pharmacologic (pulmonary embolectomy, filter placement) PE treatment .
Patient risk for early post-PE mortality was assessed using the validated In-hospital Mortality for PulmonAry embolism using Claims daTa (IMPACT) equation [1/(1 + exp(−x)); x = −5.833 + (0.026 × age) + (0.402 × myocardial infarction) + (0.368 × chronic lung disease) + (0.464 × stroke) + (0.638 × prior major bleeding) + (0.298 × atrial fibrillation) + (1.061 × cognitive impairment) + (0.554 × heart failure) + (0.364 × renal failure) + (0.484 × liver disease) + (0.523 × coagulopathy) + (1.068 × cancer)], with an estimated in-hospital mortality risk >1.5% deemed higher-risk [7–9]. We also determined the proportion of patients with characteristics placing them at higher-risk for early mortality or other complications included in the simplified PE severity index (sPESI) or Hestia criteria (age > 80 years, heart failure, chronic lung disease, renal impairment, liver disease, high-risk for major bleeding, cancer or a need for early thrombolysis/embolectomy [proxy for hemodynamic instability]) when assessable in the claims database [10, 11].
IMPACT mortality risk and patient characteristics were summarized using descriptive statistics. Percentages and means ± standard deviations or medians (25%, 75% range) were used to summarize categorical and continuous data. Statistical analysis was performed in IBM SPSS v22 (IBM Corp., Armonk, NY, USA).
In total, 47,607 hospital encounters for PE were identified and 3.4% were coded as observation stays. Using IMPACT, ~46% of observation stay patients were at higher-risk for early post-PE mortality (Table 1). Over one-third of PE patients managed via an observation stay had ≥1 criteria placing them at high-risk for early mortality. The proportion of patients with co-morbid heart failure, renal or liver disease, high-risk for major bleeding, cancer and requiring thrombolysis/pulmonary embolectomy were low (<4.5% for each), but 7.8% patients were >80 years-of-age and 19.4% had chronic lung disease. One patient died during hospitalization (out-of-hospital mortality is not available in Premier) and 28% stayed >2-midnights. High-risk patients by IMPACT or those with ≥1 high-risk criteria had longer length-of-stay (p ≤ 0.005 for both using a generalized linear model with a gamma distribution and log-link).
Our study suggest anywhere from one-third to about half of PE patients managed via an observation stay in the US would be classified as higher-risk for early post-PE mortality according to claims-based or clinical risk stratification criteria [7–11]. Advanced age and chronic lung disease were the most frequent “high-risk” characteristics identified in observation stay-managed patients.
The substantial proportion of observation stay patients in our study classified at higher-risk by IMPACT and select components of the sPESI and the Hestia criteria highlights the lack of agreement between US observation management of PE and risk stratification tools. Whether this observed disagreement suggests inappropriate use of observation stays is unknown. It does suggest; however, that risk stratification tools may be used infrequently by practitioners in routine practice [12–14]. Studies have reported common clinician barriers to using risk stratification tools including difficulties in implementation in routine practice [12, 13], lack of training in their use, regulatory constraints and the nature of the physician-patient relationship . Also of concern, risk stratification tools tend to oversimplify risk assessment (accurately identifying those at very low-risk, but classify a large majority who inevitably do not experience a complication as higher-risk) . This overall lack of prognostic accuracy likely explains some inconsistencies between tool recommendations and clinical gestalt.
Whether clinical gestalt alone is optimal for identifying PE patients suitable for abbreviated stays is unclear. In a meta-analysis by Piran et al. , the pooled risk of recurrent venous thromboembolism in outpatient-treated PE patients was shown not to differ between clinical gestalt and risk stratification methods (1.9% vs. 1.4%). Of note, nearly all studies examined in this meta-analysis were conducted in non-US centers decreasing its generalizability to US practice. Future studies to determine the prognostic accuracy of clinical gestalt in comparison to accepted risk stratification tools are needed.
Our study has limitations worth noting. First, Premier does not provide access to clinical data including vital signs (e.g., blood pressure, heart or respiratory rate, oxygen saturation), out-of-hospital mortality or clot burden. Thus, we could not apply commonly used clinical criteria, tools such as PESI or assess all criteria included in the sPESI and Hestia tools. Inclusion of these data could have only increased the percentage of patients classified as higher-risk, and as a result, we likely underestimated the percentage of patients at high-risk of early post-PE mortality. However, nearly half of observation stay patients in our analysis were identified as high-risk according to the IMPACT equation, which was specifically designed for identification of low-risk PE patients using claims data and shown to have similar prognostic accuracy for both in-hospital and 30-day mortality as PESI, sPESI and Hestia [7–9]. Second, we did not have 30-day mortality data available and therefore cannot comment on whether these observation stay and higher-risk patients had subsequent adverse outcomes after discharge. Finally, since the overall proportion of patients being managed through observations stays in the US is limited, it is possible that other unidentified factors (e.g., societal or economic) are influencing the generalizability of these findings.
Our analysis suggests patient selection for abbreviated stays is not consistent with claims-based risk stratification tools and accepted clinical criteria denoting higher-risk for early mortality.
International Classification of Diseases 9th-revision
In-hospital Mortality for PulmonAry embolism using Claims daTa
Simplified pulmonary embolism severity index
Kearon C, Akl EA, Ornelas J, et al. Antithrombotic therapy for VTE disease: CHEST guideline and expert panel review. Chest. 2016;149:315–52.
Baglin T. Fifty per cent of patients with pulmonary embolism can be treated as outpatients. J Throm Haemost. 2010;8:2404–5.
Sheehy AM, Graf BK, Gangireddy S, Formisano R, Jacobs EA. Observation status: for hospitalized patients: implications of a proposed Medicare rules change. JAMA Intern Med. 2013;173:2004–6.
Wright S. Memorandum report: hospitals’ use of observation stays and short inpatient stays for Medicare beneficiaries, OEI-02-12-00040. Washington DC: United States Department of Health and Human Services, Office of Inspector General; 2013. [Accessed 4 Mar 2016]. Available from: http://oig.hhs.gov/oei/reports/oei-02-12-00040.pdf.
Feng Z, Wright B, Mor V. Sharp rise in Medicare enrollees being held in hospitals for observation raises concerns about causes and consequences. Health Aff. 2012;31:1251–9.
Overman RA, Freburger JK, Assimon MM, Li X, Brookhart MA. Observation stays in administrative claims databases: underestimation of hospitalized cases. Pharmacoepidemiol Drug Saf. 2014;23:902–10.
Coleman CI, Kohn CG, Bunz TJ. Derivation and validation of the In-hospital Mortality for PulmonAry embolism using Claims daTa (IMPACT) prediction rule. Curr Med Res Opin. 2015;31:1461–8.
Coleman CI, Kohn CG, Crivera C, Schein JR, Peacock WF. Validation of the multivariable In-hospital Mortality for PulmonAry embolism using Claims data (IMPACT) prediction rule within an all-payer inpatient administrative claims database. BMJ Open. 2015;5:e009251.
Weeda ER, Kohn CG, Fermann GJ, et al. External validation of prognostic rules for early post-pulmonary embolism mortality: assessment of a claims-based and three clinical-based approaches. Thromb J. 2016;14:7.
Jimenez D, Aujesky D, Moores L, RIETE Investigators, et al. Simplification of the pulmonary embolism severity index for prognostication in patients with acute symptomatic pulmonary embolism. Arch Intern Med. 2010;170:1383–9.
Zondag W, den Exter PL, Crobach MJ, Hestia Study Investigators, et al. Comparison of two methods for selection of out of hospital treatment in patients with acute pulmonary embolism. Thromb Haemost. 2013;109:47–52.
Eichler K, Zoller M, Tschudi P, Steurer J. Barriers to apply cardiovascular prediction rules in primary care: a postal survey. BMC Fam Pract. 2007;8:1.
Graham ID, Logan J, Bennett CL, et al. Physicians’ intentions and use of three patient decision aids. BMC Med Inform Decis Mak. 2007;7:20.
Muller-Riemenschneider F, Holmberg C, Rieckmann N, et al. Barriers to routine risk-score use for healthy primary care patients: survey and qualitative study. Arch Intern Med. 2010;170:719–24.
Piran S, Le Gal G, Wells PS, et al. Outpatient treatment of symptomatic pulmonary embolism: a systematic review and meta-analysis. Thromb Res. 2013;132:515–9.
This study was funded by Janssen Scientific Affairs, LLC, Raritan, NJ, USA.
Availability of data and materials
The data supporting the findings of this study are available from Premier Inc. but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Premier Inc. The data used in this study was under license from Premier Inc. and provided through the study sponsor, Janssen Scientific Affairs, LLC.
Study concept and design: EN, CIC, WFP, ERW, VA, CC, JRS, TJB, GJF. Acquisition of data: EN, CIC, VA, CC, JRS. Analysis and interpretation of data: EN, CIC, WFP, PSW, ERW, VA, CC, PW, JRS, TJB, GJF. Drafting of the manuscript: EN, CIC. Critical revision of the manuscript for important intellectual content: EN, CIC, WFP, PSW, ERW, VA, CC, PW, JRS, TJB, GJF. Administrative, technical, or material support: EN, CIC, ERW, TJB, VA. Study supervision: CIC. EN, CIC and TJB had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors read and approved the final manuscript. The authors meet criteria for authorship as recommended by the International Committee of Medical Journal Editors (ICJME) and were fully responsible for all content and editorial decisions, and were involved in all stages of manuscript development.
Dr. Coleman has received grant funding and consultancy fees from Janssen Pharmaceuticals; Bayer Pharma AG and Boehringer-Ingelheim Pharmaceuticals, Inc. Dr. Peacock has received grant funding and consultancy fees from Janssen Pharmaceuticals and Portola. Dr. Wells has received grant funding from Bristol Myers Squib and Pfizer, is on the advisory board and has received speaker’s fees from Bayer Healthcare, has received consultancy fees from Janssen Pharmaceuticals, and served on a writing committee with Itreas. Ms. Ashton and Drs. Crivera, Schein, and Wildgoose are employees of Janssen Scientific Affairs LLC. Dr. Fermann has received grant funding for Pfizer and is on the advisory board and speaker’s bureau for Janssen Pharmaceuticals. Drs. Nguyen, Weeda and Bunz have no competing interests germane to this article to report.
Consent for publication
Ethics approval and consent to participate
This study was performed in accordance with the Declaration of Helsinki. All data included in the Premier Perspective Comparative Hospital Database are de-identified and are in compliance with the Health Insurance Portability and Accountability Act (HIPAA) of 1996 to preserve participant anonymity and confidentiality. For this reason, this study was exempt from institutional review board oversight and did not require an approval by an ethics committee. The data used in this study was under license from Premier Inc. and provided through the study sponsor, Janssen Scientific Affairs, LLC.
About this article
Cite this article
Nguyen, E., Coleman, C.I., Peacock, W.F. et al. Observation management of pulmonary embolism and agreement with claims-based and clinical risk stratification criteria in United States patients: a retrospective analysis. BMC Pulm Med 17, 37 (2017). https://doi.org/10.1186/s12890-017-0379-5
- Pulmonary embolism
- Observation stays
- Resource utilization