Evaluation of an Antimicrobial Stewardship Decision Support for Pediatric Infections.

2023

108-118

01/2023

1869-0327

OBJECTIVES:  Clinical decision support (CDS) has promise for the implementation of antimicrobial stewardship programs (ASPs) in the emergency department (ED). We sought to assess the usability of a newly developed automated CDS to improve guideline-adherent antibiotic prescribing for pediatric community-acquired pneumonia (CAP) and urinary tract infection (UTI).

METHODS:  We conducted comparative usability testing between an automated, prototype CDS-enhanced discharge order set and standard order set, for pediatric CAP and UTI antibiotic prescribing. After an extensive user-centered design process, the prototype CDS was integrated into the electronic health record, used passive activation, and embedded locally adapted prescribing guidelines. Participants were randomized to interact with three simulated ED scenarios of children with CAP or UTI, across both systems. Measures included task completion, decision-making and usability errors, clinical actions (order set use and correct antibiotic selection), as well as objective measures of system usability, utility, and workload using the National Aeronautics and Space Administration Task Load Index (NASA-TLX). The prototype CDS was iteratively refined to optimize usability and workflow.

RESULTS:  Usability testing in 21 ED clinical providers demonstrated that, compared to the standard order sets, providers preferred the prototype CDS, with improvements in domains such as explanations of suggested antibiotic choices ( < 0.001) and provision of additional resources on antibiotic prescription ( < 0.001). Simulated use of the CDS also led to overall improved guideline-adherent prescribing, with a 31% improvement for CAP. A trend was present toward absolute workload reduction. Using the NASA-TLX, workload scores for the current system were median 26, interquartile ranges (IQR): 11 to 41 versus median 25, and IQR: 10.5 to 39.5 for the CDS system ( = 0.117).

CONCLUSION:  Our CDS-enhanced discharge order set for ED antibiotic prescribing was strongly preferred by users, improved the accuracy of antibiotic prescribing, and trended toward reduced provider workload. The CDS was optimized for impact on guideline-adherent antibiotic prescribing from the ED and end-user acceptability to support future evaluative trials of ED ASPs.

10.1055/s-0042-1760082

Appl Clin Inform

36754066

Serious Bacterial Infections in Young Febrile Infants With Positive Urinalysis Results.

2022

09/2022

1098-4275

 

OBJECTIVE: To determine the prevalence of bacteremia and/or bacterial meningitis in febrile infants ≤60 days of age with positive urinalysis (UA) results.

METHODS: Secondary analysis of a prospective observational study of noncritical febrile infants ≤60 days between 2011 and 2019 conducted in the Pediatric Emergency Care Applied Research Network emergency departments. Participants had temperatures ≥38°C and were evaluated with blood cultures and had UAs available for analysis. We report the prevalence of bacteremia and bacterial meningitis in those with and without positive UA results.

RESULTS: Among 7180 infants, 1090 (15.2%) had positive UA results. The risk of bacteremia was higher in those with positive versus negative UA results (63/1090 [5.8%] vs 69/6090 [1.1%], difference 4.7% [3.3% to 6.1%]). There was no difference in the prevalence of bacterial meningitis in infants ≤28 days of age with positive versus negative UA results (∼1% in both groups). However, among 697 infants aged 29 to 60 days with positive UA results, there were no cases of bacterial meningitis in comparison to 9 of 4153 with negative UA results (0.2%, difference -0.2% [-0.4% to -0.1%]). In addition, there were no cases of bacteremia and/or bacterial meningitis in the 148 infants ≤60 days of age with positive UA results who had the Pediatric Emergency Care Applied Research Network low-risk blood thresholds of absolute neutrophil count <4 × 103 cells/mm3 and procalcitonin <0.5 ng/mL.

CONCLUSIONS: Among noncritical febrile infants ≤60 days of age with positive UA results, there were no cases of bacterial meningitis in those aged 29 to 60 days and no cases of bacteremia and/or bacterial meningitis in any low-risk infants based on low-risk blood thresholds in both months of life. These findings can guide lumbar puncture use and other clinical decision making.

10.1542/peds.2021-055633

Pediatrics

36097858

Invasive Bacterial Infections in Afebrile Infants Diagnosed With Acute Otitis Media.

2021

2021 01

1098-4275

<p><strong>OBJECTIVES: </strong>To determine the prevalence of invasive bacterial infections (IBIs) and adverse events in afebrile infants with acute otitis media (AOM).</p>

<p><strong>METHODS: </strong>We conducted a 33-site cross-sectional study of afebrile infants ≤90 days of age with AOM seen in emergency departments from 2007 to 2017. Eligible infants were identified using emergency department diagnosis codes and confirmed by chart review. IBIs (bacteremia and meningitis) were determined by the growth of pathogenic bacteria in blood or cerebrospinal fluid (CSF) culture. Adverse events were defined as substantial complications resulting from or potentially associated with AOM. We used generalized linear mixed-effects models to identify factors associated with IBI diagnostic testing, controlling for site-level clustering effect.</p>

<p><strong>RESULTS: </strong>Of 5270 infants screened, 1637 met study criteria. None of the 278 (0%; 95% confidence interval [CI]: 0%-1.4%) infants with blood cultures had bacteremia; 0 of 102 (0%; 95% CI: 0%-3.6%) with CSF cultures had bacterial meningitis; 2 of 645 (0.3%; 95% CI: 0.1%-1.1%) infants with 30-day follow-up had adverse events, including lymphadenitis (1) and culture-negative sepsis (1). Diagnostic testing for IBI varied across sites and by age; overall, 278 (17.0%) had blood cultures, and 102 (6.2%) had CSF cultures obtained. Compared with infants 0 to 28 days old, older infants were less likely to have blood cultures ( &lt; .001) or CSF cultures ( &lt; .001) obtained.</p>

<p><strong>CONCLUSION: </strong>Afebrile infants with clinician-diagnosed AOM have a low prevalence of IBIs and adverse events; therefore, outpatient management without diagnostic testing may be reasonable.</p>

10.1542/peds.2020-1571

Pediatrics

33288730

Implementation of a Clinical Decision Support System for Children With Minor Blunt Head Trauma Who Are at Nonnegligible Risk for Traumatic Brain Injuries.

2018

2018 Dec 22

1097-6760

<p><strong>STUDY OBJECTIVE: </strong>To determine the effect of providing risk estimates of clinically important traumatic brain injuries and management recommendations on emergency department (ED) outcomes for children with isolated intermediate Pediatric Emergency Care Applied Research Network clinically important traumatic brain injury risk factors.</p>

<p><strong>METHODS: </strong>This was a secondary analysis of a nonrandomized clinical trial with concurrent controls, conducted at 5 pediatric and 8 general EDs between November 2011 and June 2014, enrolling patients younger than 18 years who had minor blunt head trauma. After a baseline period, intervention sites received electronic clinical decision support providing patient-level clinically important traumatic brain injury risk estimates and management recommendations. The following primary outcomes in patients with one intermediate Pediatric Emergency Care Applied Research Network risk factor were compared before and after clinical decision support: proportion of ED computed tomography (CT) scans, adjusted for age, time trend, and site; and prevalence of clinically important traumatic brain injuries.</p>

<p><strong>RESULTS: </strong>The risk of clinically important traumatic brain injuries was known for 3,859 children with isolated findings (1,711 at intervention sites before clinical decision support, 1,702 at intervention sites after clinical decision support, and 446 at control sites). In this group, pooled CT proportion decreased from 24.2% to 21.6% after clinical decision support (odds ratio 0.86; 95% confidence interval 0.73 to 1.01). Decreases in CT use were noted across intervention EDs, but not in controls. The pooled adjusted odds ratio for CT use after clinical decision support was 0.73 (95% confidence interval 0.60 to 0.88). Among the entire cohort, clinically important traumatic brain injury was diagnosed at the index ED visit for 37 of 37 (100%) patients before clinical decision support and 32 of 33 patients (97.0%) after clinical decision support.</p>

<p><strong>CONCLUSION: </strong>Providing specific risks of clinically important traumatic brain injury through electronic clinical decision support was associated with a modest and safe decrease in ED CT use for children at nonnegligible risk of clinically important traumatic brain injuries.</p>

10.1016/j.annemergmed.2018.11.011

Ann Emerg Med

30583957

Use of Traumatic Brain Injury Prediction Rules With Clinical Decision Support.

2017

2017 Mar 24

1098-4275

<p><strong>OBJECTIVES: </strong>We determined whether implementing the Pediatric Emergency Care Applied Research Network (PECARN) traumatic brain injury (TBI) prediction rules and providing risks of clinically important TBIs (ciTBIs) with computerized clinical decision support (CDS) reduces computed tomography (CT) use for children with minor head trauma.</p>

<p><strong>METHODS: </strong>Nonrandomized trial with concurrent controls at 5 pediatric emergency departments (PEDs) and 8 general EDs (GEDs) between November 2011 and June 2014. Patients were &lt;18 years old with minor blunt head trauma. Intervention sites received CDS with CT recommendations and risks of ciTBI, both for patients at very low risk of ciTBI (no Pediatric Emergency Care Applied Research Network rule factors) and those not at very low risk. The primary outcome was the rate of CT, analyzed by site, controlling for time trend.</p>

<p><strong>RESULTS: </strong>We analyzed 16 635 intervention and 2394 control patients. Adjusted for time trends, CT rates decreased significantly (P &lt; .05) but modestly (2.3%-3.7%) at 2 of 4 intervention PEDs for children at very low risk. The other 2 PEDs had small (0.8%-1.5%) nonsignificant decreases. CT rates did not decrease consistently at the intervention GEDs, with low baseline CT rates (2.1%-4.0%) in those at very low risk. The control PED had little change in CT use in similar children (from 1.6% to 2.9%); the control GED showed a decrease in the CT rate (from 7.1% to 2.6%). For all children with minor head trauma, intervention sites had small decreases in CT rates (1.7%-6.2%).</p>

<p><strong>CONCLUSIONS: </strong>The implementation of TBI prediction rules and provision of risks of ciTBIs by using CDS was associated with modest, safe, but variable decreases in CT use. However, some secular trends were also noted.</p>

10.1542/peds.2016-2709

Pediatrics

28341799

Current State of Antimicrobial Stewardship in Children's Hospital Emergency Departments.

2017

1-7

2017 Feb 08

1559-6834

<p>BACKGROUND Antimicrobial stewardship programs (ASPs) effectively optimize antibiotic use for inpatients; however, the extent of emergency department (ED) involvement in ASPs has not been described.</p>

<p>OBJECTIVE To determine current ED involvement in children's hospital ASPs and to assess beliefs and preferred methods of implementation for ED-based ASPs.</p>

<p>METHODS A cross-sectional survey of 37 children's hospitals participating in the Sharing Antimicrobial Resistance Practices collaboration was conducted. Surveys were distributed to ASP leaders and ED medical directors at each institution. Items assessed included beliefs regarding ED antibiotic prescribing, ED prescribing resources, ASP methods used in the ED such as clinical decision support and clinical care guidelines, ED participation in ASP activities, and preferred methods for ED-based ASP implementation.</p>

<p>RESULTS A total of 36 ASP leaders (97.3%) and 32 ED directors (86.5%) responded; the overall response rate was 91.9%. Most ASP leaders (97.8%) and ED directors (93.7%) agreed that creation of ED-based ASPs was necessary. ED resources for antibiotic prescribing were obtained via the Internet or electronic health records (EHRs) for 29 hospitals (81.3%). The main ASP activities for the ED included production of antibiograms (77.8%) and creation of clinical care guidelines for pneumonia (83.3%). The ED was represented on 3 hospital ASP committees (8.3%). No hospital ASPs actively monitored outpatient ED prescribing. Most ASP leaders (77.8%) and ED directors (81.3%) preferred implementation of ED-based ASPs using clinical decision support integrated into the EHR.</p>

<p>CONCLUSIONS Although ED involvement in ASPs is limited, both ASP and ED leaders believe that ED-based ASPs are necessary. Many children's hospitals have the capability to implement ED-based ASPs via the preferred method: EHR clinical decision support.</p>

10.1017/ice.2017.3

Infect Control Hosp Epidemiol

28173888

Use of a remote clinical decision support service for a multicenter trial to implement prediction rules for children with minor blunt head trauma.

2016

101-10

2016 Mar

1872-8243

<p><strong>OBJECTIVE: </strong>To evaluate the architecture, integration requirements, and execution characteristics of a remote clinical decision support (CDS) service used in a multicenter clinical trial. The trial tested the efficacy of implementing brain injury prediction rules for children with minor blunt head trauma.</p>

<p><strong>MATERIALS AND METHODS: </strong>We integrated the Epic(®) electronic health record (EHR) with the Enterprise Clinical Rules Service (ECRS), a web-based CDS service, at two emergency departments. Patterns of CDS review included either a delayed, near-real-time review, where the physician viewed CDS recommendations generated by the nursing assessment, or a real-time review, where the physician viewed recommendations generated by their own documentation. A backstopping, vendor-based CDS triggered with zero delay when no recommendation was available in the EHR from the web-service. We assessed the execution characteristics of the integrated system and the source of the generated recommendations viewed by physicians.</p>

<p><strong>RESULTS: </strong>The ECRS mean execution time was 0.74 ±0.72 s. Overall execution time was substantially different at the two sites, with mean total transaction times of 19.67 and 3.99 s. Of 1930 analyzed transactions from the two sites, 60% (310/521) of all physician documentation-initiated recommendations and 99% (1390/1409) of all nurse documentation-initiated recommendations originated from the remote web service.</p>

<p><strong>DISCUSSION: </strong>The remote CDS system was the source of recommendations in more than half of the real-time cases and virtually all the near-real-time cases. Comparisons are limited by allowable variation in user workflow and resolution of the EHR clock.</p>

<p><strong>CONCLUSION: </strong>With maturation and adoption of standards for CDS services, remote CDS shows promise to decrease time-to-trial for multicenter evaluations of candidate decision support interventions.</p>

10.1016/j.ijmedinf.2015.12.002

Int J Med Inform

26806717

Clinical Decision Support for a Multicenter Trial of Pediatric Head Trauma: Development, Implementation, and Lessons Learned.

2016

534-42

2016

1869-0327

<p><strong>INTRODUCTION: </strong>For children who present to emergency departments (EDs) due to blunt head trauma, ED clinicians must decide who requires computed tomography (CT) scanning to evaluate for traumatic brain injury (TBI). The Pediatric Emergency Care Applied Research Network (PECARN) derived and validated two age-based prediction rules to identify children at very low risk of clinically-important traumatic brain injuries (ciTBIs) who do not typically require CT scans. In this case report, we describe the strategy used to implement the PECARN TBI prediction rules via electronic health record (EHR) clinical decision support (CDS) as the intervention in a multicenter clinical trial.</p>

<p><strong>METHODS: </strong>Thirteen EDs participated in this trial. The 10 sites receiving the CDS intervention used the Epic(®) EHR. All sites implementing EHR-based CDS built the rules by using the vendor's CDS engine. Based on a sociotechnical analysis, we designed the CDS so that recommendations could be displayed immediately after any provider entered prediction rule data. One central site developed and tested the intervention package to be exported to other sites. The intervention package included a clinical trial alert, an electronic data collection form, the CDS rules and the format for recommendations.</p>

<p><strong>RESULTS: </strong>The original PECARN head trauma prediction rules were derived from physician documentation while this pragmatic trial led each site to customize their workflows and allow multiple different providers to complete the head trauma assessments. These differences in workflows led to varying completion rates across sites as well as differences in the types of providers completing the electronic data form. Site variation in internal change management processes made it challenging to maintain the same rigor across all sites. This led to downstream effects when data reports were developed.</p>

<p><strong>CONCLUSIONS: </strong>The process of a centralized build and export of a CDS system in one commercial EHR system successfully supported a multicenter clinical trial.</p>

10.4338/ACI-2015-10-CR-0144

Appl Clin Inform

27437059