Clinical Decision Support Stewardship: Best Practices and Techniques to Monitor and Improve Interruptive Alerts.

2022

560-568

05/2022

1869-0327

Interruptive clinical decision support systems, both within and outside of electronic health records, are a resource that should be used sparingly and monitored closely. Excessive use of interruptive alerting can quickly lead to alert fatigue and decreased effectiveness and ignoring of alerts. In this review, we discuss the evidence for effective alert stewardship as well as practices and methods we have found useful to assess interruptive alert burden, reduce excessive firings, optimize alert effectiveness, and establish quality governance at our institutions. We also discuss the importance of a holistic view of the alerting ecosystem beyond the electronic health record.

10.1055/s-0042-1748856

Appl Clin Inform

35613913

Alert burden in pediatric hospitals: a cross-sectional analysis of six academic pediatric health systems using novel metrics.

2021

2021 Oct 19

1527-974X

<p><strong>BACKGROUND: </strong>Excessive electronic health record (EHR) alerts reduce the salience of actionable alerts. Little is known about the frequency of interruptive alerts across health systems and how the choice of metric affects which users appear to have the highest alert burden.</p>

<p><strong>OBJECTIVE: </strong>(1) Analyze alert burden by alert type, care setting, provider type, and individual provider across 6 pediatric health systems. (2) Compare alert burden using different metrics.</p>

<p><strong>MATERIALS AND METHODS: </strong>We analyzed interruptive alert firings logged in EHR databases at 6 pediatric health systems from 2016-2019 using 4 metrics: (1) alerts per patient encounter, (2) alerts per inpatient-day, (3) alerts per 100 orders, and (4) alerts per unique clinician days (calendar days with at least 1 EHR log in the system). We assessed intra- and interinstitutional variation and how alert burden rankings differed based on the chosen metric.</p>

<p><strong>RESULTS: </strong>Alert burden varied widely across institutions, ranging from 0.06 to 0.76 firings per encounter, 0.22 to 1.06 firings per inpatient-day, 0.98 to 17.42 per 100 orders, and 0.08 to 3.34 firings per clinician day logged in the EHR. Custom alerts accounted for the greatest burden at all 6 sites. The rank order of institutions by alert burden was similar regardless of which alert burden metric was chosen. Within institutions, the alert burden metric choice substantially affected which provider types and care settings appeared to experience the highest alert burden.</p>

<p><strong>CONCLUSION: </strong>Estimates of the clinical areas with highest alert burden varied substantially by institution and based on the metric used.</p>

10.1093/jamia/ocab179

J Am Med Inform Assoc

34664664

Performance of a Clinical Decision Support Tool to Identify PICU Patients at High Risk for Clinical Deterioration.

2019

2019 Oct 02

1529-7535

<p><strong>OBJECTIVES: </strong>To evaluate the translation of a paper high-risk checklist for PICU patients at risk of clinical deterioration to an automated clinical decision support tool.</p>

<p><strong>DESIGN: </strong>Retrospective, observational cohort study of an automated clinical decision support tool, the PICU Warning Tool, adapted from a paper checklist to predict clinical deterioration events in PICU patients within 24 hours.</p>

<p><strong>SETTING: </strong>Two quaternary care medical-surgical PICUs-The Children's Hospital of Philadelphia and Cincinnati Children's Hospital Medical Center.</p>

<p><strong>PATIENTS: </strong>The study included all patients admitted from July 1, 2014, to June 30, 2015, the year prior to the initiation of any focused situational awareness work at either institution.</p>

<p><strong>INTERVENTIONS: </strong>We replicated the predictions of the real-time PICU Warning Tool by retrospectively querying the institutional data warehouse to identify all patients that would have flagged as high-risk by the PICU Warning Tool for their index deterioration.</p>

<p><strong>MEASUREMENTS AND MAIN RESULTS: </strong>The primary exposure of interest was determination of high-risk status during PICU admission via the PICU Warning Tool. The primary outcome of interest was clinical deterioration event within 24 hours of a positive screen. The date and time of the deterioration event was used as the index time point. We evaluated the sensitivity, specificity, positive predictive value, and negative predictive value of the performance of the PICU Warning Tool. There were 6,233 patients evaluated with 233 clinical deterioration events experienced by 154 individual patients. The positive predictive value of the PICU Warning Tool was 7.1% with a number needed to screen of 14 patients for each index clinical deterioration event. The most predictive of the individual criteria were elevated lactic acidosis, high mean airway pressure, and profound acidosis.</p>

<p><strong>CONCLUSIONS: </strong>Performance of a clinical decision support translation of a paper-based tool showed inferior test characteristics. Improved feasibility of identification of high-risk patients using automated tools must be balanced with performance.</p>

10.1097/PCC.0000000000002106

Pediatr Crit Care Med

31577691

Federating clinical data from six pediatric hospitals: process and initial results for microbiology from the PHIS+ consortium.

2012

281-90

2012

1942-597X

<p>Microbiology study results are necessary for conducting many comparative effectiveness research studies. Unlike core laboratory test results, microbiology results have a complex structure. Federating and integrating microbiology data from six disparate electronic medical record systems is challenging and requires a team of varied skills. The PHIS+ consortium which is partnership between members of the Pediatric Research in Inpatient Settings (PRIS) network, the Children's Hospital Association and the University of Utah, have used "FURTHeR' for federating laboratory data. We present our process and initial results for federating microbiology data from six pediatric hospitals.</p>

AMIA Annu Symp Proc

23304298

Federating clinical data from six pediatric hospitals: process and initial results from the PHIS+ Consortium.

2011

994-1003

2011

1942-597X

<p>Integrating clinical data with administrative data across disparate electronic medical record systems will help improve the internal and external validity of comparative effectiveness research. The Pediatric Health Information System (PHIS) currently collects administrative information from 43 pediatric hospital members of the Child Health Corporation of America (CHCA). Members of the Pediatric Research in Inpatient Settings (PRIS) network have partnered with CHCA and the University of Utah Biomedical Informatics Core to create an enhanced version of PHIS that includes clinical data. A specialized version of a data federation architecture from the University of Utah ("FURTHeR") is being developed to integrate the clinical data from the member hospitals into a common repository ("PHIS+") that is joined with the existing administrative data. We report here on our process for the first phase of federating lab data, and present initial results.</p>

AMIA Annu Symp Proc

22195159