First name
Eric
Middle name
S
Last name
Kirkendall

Title

Clinical Decision Support Stewardship: Best Practices and Techniques to Monitor and Improve Interruptive Alerts.

Year of Publication

2022

Number of Pages

560-568

Date Published

05/2022

ISSN Number

1869-0327

Abstract

Interruptive clinical decision support systems, both within and outside of electronic health records, are a resource that should be used sparingly and monitored closely. Excessive use of interruptive alerting can quickly lead to alert fatigue and decreased effectiveness and ignoring of alerts. In this review, we discuss the evidence for effective alert stewardship as well as practices and methods we have found useful to assess interruptive alert burden, reduce excessive firings, optimize alert effectiveness, and establish quality governance at our institutions. We also discuss the importance of a holistic view of the alerting ecosystem beyond the electronic health record.

DOI

10.1055/s-0042-1748856

Alternate Title

Appl Clin Inform

PMID

35613913
Inner Banner
Publication Image
Inner Banner
Publication Image

Title

Alert burden in pediatric hospitals: a cross-sectional analysis of six academic pediatric health systems using novel metrics.

Year of Publication

2021

Number of Pages

Date Published

2021 Oct 19

ISSN Number

1527-974X

Abstract

<p><strong>BACKGROUND: </strong>Excessive electronic health record (EHR) alerts reduce the salience of actionable alerts. Little is known about the frequency of interruptive alerts across health systems and how the choice of metric affects which users appear to have the highest alert burden.</p>

<p><strong>OBJECTIVE: </strong>(1) Analyze alert burden by alert type, care setting, provider type, and individual provider across 6 pediatric health systems. (2) Compare alert burden using different metrics.</p>

<p><strong>MATERIALS AND METHODS: </strong>We analyzed interruptive alert firings logged in EHR databases at 6 pediatric health systems from 2016-2019 using 4 metrics: (1) alerts per patient encounter, (2) alerts per inpatient-day, (3) alerts per 100 orders, and (4) alerts per unique clinician days (calendar days with at least 1 EHR log in the system). We assessed intra- and interinstitutional variation and how alert burden rankings differed based on the chosen metric.</p>

<p><strong>RESULTS: </strong>Alert burden varied widely across institutions, ranging from 0.06 to 0.76 firings per encounter, 0.22 to 1.06 firings per inpatient-day, 0.98 to 17.42 per 100 orders, and 0.08 to 3.34 firings per clinician day logged in the EHR. Custom alerts accounted for the greatest burden at all 6 sites. The rank order of institutions by alert burden was similar regardless of which alert burden metric was chosen. Within institutions, the alert burden metric choice substantially affected which provider types and care settings appeared to experience the highest alert burden.</p>

<p><strong>CONCLUSION: </strong>Estimates of the clinical areas with highest alert burden varied substantially by institution and based on the metric used.</p>

DOI

10.1093/jamia/ocab179

Alternate Title

J Am Med Inform Assoc

PMID

34664664
Inner Banner
Publication Image
Inner Banner
Publication Image

Title

Performance of a Clinical Decision Support Tool to Identify PICU Patients at High Risk for Clinical Deterioration.

Year of Publication

2019

Number of Pages

Date Published

2019 Oct 02

ISSN Number

1529-7535

Abstract

<p><strong>OBJECTIVES: </strong>To evaluate the translation of a paper high-risk checklist for PICU patients at risk of clinical deterioration to an automated clinical decision support tool.</p>

<p><strong>DESIGN: </strong>Retrospective, observational cohort study of an automated clinical decision support tool, the PICU Warning Tool, adapted from a paper checklist to predict clinical deterioration events in PICU patients within 24 hours.</p>

<p><strong>SETTING: </strong>Two quaternary care medical-surgical PICUs-The Children's Hospital of Philadelphia and Cincinnati Children's Hospital Medical Center.</p>

<p><strong>PATIENTS: </strong>The study included all patients admitted from July 1, 2014, to June 30, 2015, the year prior to the initiation of any focused situational awareness work at either institution.</p>

<p><strong>INTERVENTIONS: </strong>We replicated the predictions of the real-time PICU Warning Tool by retrospectively querying the institutional data warehouse to identify all patients that would have flagged as high-risk by the PICU Warning Tool for their index deterioration.</p>

<p><strong>MEASUREMENTS AND MAIN RESULTS: </strong>The primary exposure of interest was determination of high-risk status during PICU admission via the PICU Warning Tool. The primary outcome of interest was clinical deterioration event within 24 hours of a positive screen. The date and time of the deterioration event was used as the index time point. We evaluated the sensitivity, specificity, positive predictive value, and negative predictive value of the performance of the PICU Warning Tool. There were 6,233 patients evaluated with 233 clinical deterioration events experienced by 154 individual patients. The positive predictive value of the PICU Warning Tool was 7.1% with a number needed to screen of 14 patients for each index clinical deterioration event. The most predictive of the individual criteria were elevated lactic acidosis, high mean airway pressure, and profound acidosis.</p>

<p><strong>CONCLUSIONS: </strong>Performance of a clinical decision support translation of a paper-based tool showed inferior test characteristics. Improved feasibility of identification of high-risk patients using automated tools must be balanced with performance.</p>

DOI

10.1097/PCC.0000000000002106

Alternate Title

Pediatr Crit Care Med

PMID

31577691
Inner Banner
Publication Image
Inner Banner
Publication Image

Title

Federating clinical data from six pediatric hospitals: process and initial results for microbiology from the PHIS+ consortium.

Year of Publication

2012

Number of Pages

281-90

Date Published

2012

ISSN Number

1942-597X

Abstract

<p>Microbiology study results are necessary for conducting many comparative effectiveness research studies. Unlike core laboratory test results, microbiology results have a complex structure. Federating and integrating microbiology data from six disparate electronic medical record systems is challenging and requires a team of varied skills. The PHIS+ consortium which is partnership between members of the Pediatric Research in Inpatient Settings (PRIS) network, the Children's Hospital Association and the University of Utah, have used "FURTHeR' for federating laboratory data. We present our process and initial results for federating microbiology data from six pediatric hospitals.</p>

DOI

Alternate Title

AMIA Annu Symp Proc

PMID

23304298
Inner Banner
Publication Image
Inner Banner
Publication Image

Title

Federating clinical data from six pediatric hospitals: process and initial results from the PHIS+ Consortium.

Year of Publication

2011

Number of Pages

994-1003

Date Published

2011

ISSN Number

1942-597X

Abstract

<p>Integrating clinical data with administrative data across disparate electronic medical record systems will help improve the internal and external validity of comparative effectiveness research. The Pediatric Health Information System (PHIS) currently collects administrative information from 43 pediatric hospital members of the Child Health Corporation of America (CHCA). Members of the Pediatric Research in Inpatient Settings (PRIS) network have partnered with CHCA and the University of Utah Biomedical Informatics Core to create an enhanced version of PHIS that includes clinical data. A specialized version of a data federation architecture from the University of Utah ("FURTHeR") is being developed to integrate the clinical data from the member hospitals into a common repository ("PHIS+") that is joined with the existing administrative data. We report here on our process for the first phase of federating lab data, and present initial results.</p>

DOI

Alternate Title

AMIA Annu Symp Proc

PMID

22195159
Inner Banner
Publication Image
Inner Banner
Publication Image