Queries of electronic health record (EHR) data repositories allow for automated data collection. These techniques have not been used in hepatology due to the inability to capture hepatic encephalopathy (HE) grades, which are inputs for acute-on-chronic liver failure (ACLF) models. Here, we describe a methodology to use EHR data to calculate rolling ACLF scores. We examined 239 patient admissions with end-stage liver disease from July 2014 to June 2019. We mapped EHR flowsheet data to determine HE grades and calculated two longitudinally updated ACLF scores. We validated HE grades and ACLF diagnoses by chart review and calculated sensitivity, specificity, and Cohen's kappa. Of 239 patient admissions analyzed, 37% were women, 46% were non-Hispanic white, median age was 60 years, and the median Model for End-Stage Liver Disease-Na score at admission was 25. Of the 239, 7% were diagnosed with ACLF as defined by the North American Consortium for the Study of End-Stage Liver Disease (NACSELD) diagnostic criteria at admission, 27% during the hospitalization, and 9% at discharge. Forty percent were diagnosed with ACLF by the European Association for the Study of the Liver- Chronic Liver Failure Consortium (CLIF-C) diagnostic criteria at admission, 51% during the hospitalization, and 34% at discharge. From the chart review of 51 admissions, we found sensitivities and specificities for any HE (grades 1-4) were 92%-97% and 76%-95%, respectively; for severe HE (grades 3-4), sensitivities and specificities were 100% and 78%-98%, respectively. Cohen's kappa between flowsheet and chart review of HE grades ranged from 0.55 to 0.72. Sensitivities and specificities for NACSELD-ACLF diagnoses were 75%-100% and 96%-100%, respectively; for CLIF-C-ACLF diagnoses, these were 91%-100% and 96-100%, respectively. We generated approximately 28 unique ACLF scores per patient per admission day. Conclusion: We developed an informatics-based methodology to calculate longitudinally updated ACLF scores. This opens new analytic potentials, such as big data methods, to develop electronic phenotypes for patients with ACLF.

Objectives

The study sought to determine whether objective measures of electronic health record (EHR) use-related to time, volume of work, and proficiency-are associated with either or both components of clinician burnout: exhaustion and cynicism.

Materials and methods

We combined Maslach Burnout Inventory survey measures (94% response rate; 122 of 130 clinicians) with objective, vendor-defined EHR use measures from log files (time after hours on clinic days; time on nonclinic days; message volume; composite measures of efficiency and proficiency). Data were collected in early 2018 from all primary care clinics of a large, urban, academic medical center. Multivariate regression models measured the association between each burnout component and each EHR use measure.

Results

One-third (34%) of clinicians had high cynicism and 51% had high emotional exhaustion. Clinicians in the top 2 quartiles of EHR time after hours on scheduled clinic days (those above the sample median of 68 minutes per clinical full-time equivalent per week) had 4.78 (95% confidence interval [CI], 1.1-20.1; P = .04) and 12.52 (95% CI, 2.6-61; P = .002) greater odds of high exhaustion. Clinicians in the top quartile of message volume (>307 messages per clinical full-time equivalent per week) had 6.17 greater odds of high exhaustion (95% CI, 1.1-41; P = .04). No measures were associated with high cynicism.

Discussion

EHRs have been cited as a contributor to clinician burnout, and self-reported data suggest a relationship between EHR use and burnout. As organizations increasingly rely on objective, vendor-defined EHR measures to design and evaluate interventions to reduce burnout, our findings point to the measures that should be targeted.

Conclusions

Two specific EHR use measures were associated with exhaustion.

Background

Two acute respiratory distress syndrome (ARDS) subphenotypes (hyperinflammatory and hypoinflammatory) with distinct clinical and biological features and differential treatment responses have been identified using latent class analysis (LCA) in seven individual cohorts. To facilitate bedside identification of subphenotypes, clinical classifier models using readily available clinical variables have been described in four randomised controlled trials. We aimed to assess the performance of these models in observational cohorts of ARDS.

Methods

In this observational, multicohort, retrospective study, we validated two machine-learning clinical classifier models for assigning ARDS subphenotypes in two observational cohorts of patients with ARDS: Early Assessment of Renal and Lung Injury (EARLI; n=335) and Validating Acute Lung Injury Markers for Diagnosis (VALID; n=452), with LCA-derived subphenotypes as the gold standard. The primary model comprised only vital signs and laboratory variables, and the secondary model comprised all predictors in the primary model, with the addition of ventilatory variables and demographics. Model performance was assessed by calculating the area under the receiver operating characteristic curve (AUC) and calibration plots, and assigning subphenotypes using a probability cutoff value of 0·5 to determine sensitivity, specificity, and accuracy of the assignments. We also assessed the performance of the primary model in EARLI using data automatically extracted from an electronic health record (EHR; EHR-derived EARLI cohort). In Large Observational Study to Understand the Global Impact of Severe Acute Respiratory Failure (LUNG SAFE; n=2813), a multinational, observational ARDS cohort, we applied a custom classifier model (with fewer variables than the primary model) to determine the prognostic value of the subphenotypes and tested their interaction with the positive end-expiratory pressure (PEEP) strategy, with 90-day mortality as the dependent variable.

Findings

The primary clinical classifier model had an area under receiver operating characteristic curve (AUC) of 0·92 (95% CI 0·90-0·95) in EARLI and 0·88 (0·84-0·91) in VALID. Performance of the primary model was similar when using exclusively EHR-derived predictors compared with manually curated predictors (AUC=0·88 [95% CI 0·81-0·94] vs 0·92 [0·88-0·97]). In LUNG SAFE, 90-day mortality was higher in patients assigned the hyperinflammatory subphenotype than in those with the hypoinflammatory phenotype (414 [57%] of 725 vs 694 [33%] of 2088; p<0·0001). There was a significant treatment interaction with PEEP strategy and ARDS subphenotype (p=0·041), with lower 90-day mortality in the high PEEP group of patients with the hyperinflammatory subphenotype (hyperinflammatory subphenotype: 169 [54%] of 313 patients in the high PEEP group vs 127 [62%] of 205 patients in the low PEEP group; hypoinflammatory subphenotype: 231 [34%] of 675 patients in the high PEEP group vs 233 [32%] of 734 patients in the low PEEP group).

Interpretation

Classifier models using clinical variables alone can accurately assign ARDS subphenotypes in observational cohorts. Application of these models can provide valuable prognostic information and could inform management strategies for personalised treatment, including application of PEEP, once prospectively validated.

Funding

US National Institutes of Health and European Society of Intensive Care Medicine.