Clinical decision support with a comprehensive in-EHR patient tracking system improves genetic testing follow up.

2023

04/2023

1527-974X

OBJECTIVE: We sought to develop and evaluate an electronic health record (EHR) genetic testing tracking system to address the barriers and limitations of existing spreadsheet-based workarounds.

MATERIALS AND METHODS: We evaluated the spreadsheet-based system using mixed effects logistic regression to identify factors associated with delayed follow up. These factors informed the design of an EHR-integrated genetic testing tracking system. After deployment, we assessed the system in 2 ways. We analyzed EHR access logs and note data to assess patient outcomes and performed semistructured interviews with users to identify impact of the system on work.

RESULTS: We found that patient-reported race was a significant predictor of documented genetic testing follow up, indicating a possible inequity in care. We implemented a CDS system including a patient data capture form and management dashboard to facilitate important care tasks. The system significantly sped review of results and significantly increased documentation of follow-up recommendations. Interviews with key system users identified a range of sociotechnical factors (ie, tools, tasks, collaboration) that contribute to safer and more efficient care.

DISCUSSION: Our new tracking system ended decades of workarounds for identifying and communicating test results and improved clinical workflows. Interview participants related that the system decreased cognitive and time burden which allowed them to focus on direct patient interaction.

CONCLUSION: By assembling a multidisciplinary team, we designed a novel patient tracking system that improves genetic testing follow up. Similar approaches may be effective in other clinical settings.

10.1093/jamia/ocad070

J Am Med Inform Assoc

37080563

Clinical decision support with a comprehensive in-EHR patient tracking system improves genetic testing follow up.

2023

04/2023

1527-974X

OBJECTIVE: We sought to develop and evaluate an electronic health record (EHR) genetic testing tracking system to address the barriers and limitations of existing spreadsheet-based workarounds.

MATERIALS AND METHODS: We evaluated the spreadsheet-based system using mixed effects logistic regression to identify factors associated with delayed follow up. These factors informed the design of an EHR-integrated genetic testing tracking system. After deployment, we assessed the system in 2 ways. We analyzed EHR access logs and note data to assess patient outcomes and performed semistructured interviews with users to identify impact of the system on work.

RESULTS: We found that patient-reported race was a significant predictor of documented genetic testing follow up, indicating a possible inequity in care. We implemented a CDS system including a patient data capture form and management dashboard to facilitate important care tasks. The system significantly sped review of results and significantly increased documentation of follow-up recommendations. Interviews with key system users identified a range of sociotechnical factors (ie, tools, tasks, collaboration) that contribute to safer and more efficient care.

DISCUSSION: Our new tracking system ended decades of workarounds for identifying and communicating test results and improved clinical workflows. Interview participants related that the system decreased cognitive and time burden which allowed them to focus on direct patient interaction.

CONCLUSION: By assembling a multidisciplinary team, we designed a novel patient tracking system that improves genetic testing follow up. Similar approaches may be effective in other clinical settings.

10.1093/jamia/ocad070

J Am Med Inform Assoc

37080563

A Clinical Decision Support System for Motivational Messaging and Tobacco Cessation Treatment for Parents: Pilot Evaluation of Use and Acceptance.

2023

03/2023

1869-0327

BACKGROUND: Research is needed to identify how clinical decision support (CDS) systems can support communication about and engagement with tobacco use treatment in pediatric settings for parents who smoke. We developed a CDS system that identifies parents who smoke, delivers motivational messages to start treatment, connects parents to treatment, and supports pediatrician-parent discussion.

OBJECTIVE: To assess the performance of this system in clinical practice, including receipt of motivational messages and tobacco use treatment acceptance rates.

METHODS: The system was evaluated at one large pediatric practice through a single-arm pilot study from June-November 2021. We collected data on the performance of the CDS system for all parents. Additionally, we surveyed a sample of parents immediately after the clinical encounter who used the system and reported smoking. Measures were: 1) the parent remembered the motivational message, 2) the pediatrician reinforced the message, and 3) treatment acceptance rates. Treatments included nicotine replacement therapy, quitline referral (phone counseling), and/or SmokefreeTXT referral (text-message counseling). We described survey response rates overall and with 95% confidence intervals (CI).

RESULTS: During the entire study period, 8488 parents completed use of the CDS: 9.3% (n=786) reported smoking, and 48.2% (n=379) accepted at least one treatment. One hundred and two parents who smoke who used the system were approached to survey 100 parents (98% response rate). Most parents self-identified as female (84%), aged 25-34 years (56%), and Black/African American (94%), and had children with Medicaid insurance (95%). Of parents surveyed, 54% accepted at least one treatment option. Most parents recalled the motivational message (79%; 95% CI: 71-87%), and 31% (95% CI: 19-44%) reported the pediatrician reinforced the motivational message.

CONCLUSION: A CDS system to support parental tobacco use treatment in pediatric primary care enhanced motivational messaging about smoking cessation and evidence-based treatment initiation.

10.1055/a-2062-9627

Appl Clin Inform

36972687

A Clinical Decision Support System for Motivational Messaging and Tobacco Cessation Treatment for Parents: Pilot Evaluation of Use and Acceptance.

2023

03/2023

1869-0327

BACKGROUND: Research is needed to identify how clinical decision support (CDS) systems can support communication about and engagement with tobacco use treatment in pediatric settings for parents who smoke. We developed a CDS system that identifies parents who smoke, delivers motivational messages to start treatment, connects parents to treatment, and supports pediatrician-parent discussion.

OBJECTIVE: To assess the performance of this system in clinical practice, including receipt of motivational messages and tobacco use treatment acceptance rates.

METHODS: The system was evaluated at one large pediatric practice through a single-arm pilot study from June-November 2021. We collected data on the performance of the CDS system for all parents. Additionally, we surveyed a sample of parents immediately after the clinical encounter who used the system and reported smoking. Measures were: 1) the parent remembered the motivational message, 2) the pediatrician reinforced the message, and 3) treatment acceptance rates. Treatments included nicotine replacement therapy, quitline referral (phone counseling), and/or SmokefreeTXT referral (text-message counseling). We described survey response rates overall and with 95% confidence intervals (CI).

RESULTS: During the entire study period, 8488 parents completed use of the CDS: 9.3% (n=786) reported smoking, and 48.2% (n=379) accepted at least one treatment. One hundred and two parents who smoke who used the system were approached to survey 100 parents (98% response rate). Most parents self-identified as female (84%), aged 25-34 years (56%), and Black/African American (94%), and had children with Medicaid insurance (95%). Of parents surveyed, 54% accepted at least one treatment option. Most parents recalled the motivational message (79%; 95% CI: 71-87%), and 31% (95% CI: 19-44%) reported the pediatrician reinforced the motivational message.

CONCLUSION: A CDS system to support parental tobacco use treatment in pediatric primary care enhanced motivational messaging about smoking cessation and evidence-based treatment initiation.

10.1055/a-2062-9627

Appl Clin Inform

36972687

Trends in Vaccine Refusal and Acceptance Using Electronic Health Records from a Large Pediatric Hospital Network, 2013-2020: Strategies for Change.

2022

10/2022

2076-393X

Understanding trends in vaccine refusal is critical to monitor as small declines in vaccination coverage can lead to outbreaks of vaccine-preventable diseases. Using electronic heath record (EHR) data from the Children's Hospital of Philadelphia's 31 outpatient primary care sites, we created a cohort of 403,448 children less than age 20 years who received at least one visit from 1 January 2013 through 31 December 2020. The sample represented 1,449,061 annualized patient and 181,131 annualized preventive vaccination visits per year. We characterized trends in vaccine refusal and acceptance using a repeated cross-sectional observational analysis of electronic health records (EHR) data using a single annual merged observation measure for patients seen multiple times for preventive healthcare within a calendar year. Refusals were identified for 212,900 annualized patient-visit year observations, which represented 14.6% of annualized patient-visit year observations and 25.1% of annualized vaccine patient-year observations. The odds of having a refusal marker were significantly increased in patients seen in suburban practices (aOR [CI]: 2.35 [2.30-2.40, < 0.001]), in patients with increased age 11-17 years (aOR [CI]: 3.85 [3.79-3.91], < 0.001), and those eligible for the VFC program (aOR [CI]: 1.10 [1.08-1.11]. Parental refusal (61.0%) and provider decisions (32.0%) were the most common documented in progress notes for not administering vaccines, whereas contraindications (2.5%) and supply issues (1.8%) were the least common. When offered, vaccine acceptance increased for human papillomavirus, hepatitis B, measles-mumps-rubella-containing and varicella-containing vaccines and decreased for hepatitis A and meningococcal vaccines. Repeated offering of vaccines was central to increasing acceptance, in part due to increased opportunities to address specific concerns.

10.3390/vaccines10101688

Vaccines (Basel)

36298553

Evaluation of an Antimicrobial Stewardship Decision Support for Pediatric Infections.

2023

108-118

01/2023

1869-0327

OBJECTIVES:  Clinical decision support (CDS) has promise for the implementation of antimicrobial stewardship programs (ASPs) in the emergency department (ED). We sought to assess the usability of a newly developed automated CDS to improve guideline-adherent antibiotic prescribing for pediatric community-acquired pneumonia (CAP) and urinary tract infection (UTI).

METHODS:  We conducted comparative usability testing between an automated, prototype CDS-enhanced discharge order set and standard order set, for pediatric CAP and UTI antibiotic prescribing. After an extensive user-centered design process, the prototype CDS was integrated into the electronic health record, used passive activation, and embedded locally adapted prescribing guidelines. Participants were randomized to interact with three simulated ED scenarios of children with CAP or UTI, across both systems. Measures included task completion, decision-making and usability errors, clinical actions (order set use and correct antibiotic selection), as well as objective measures of system usability, utility, and workload using the National Aeronautics and Space Administration Task Load Index (NASA-TLX). The prototype CDS was iteratively refined to optimize usability and workflow.

RESULTS:  Usability testing in 21 ED clinical providers demonstrated that, compared to the standard order sets, providers preferred the prototype CDS, with improvements in domains such as explanations of suggested antibiotic choices ( < 0.001) and provision of additional resources on antibiotic prescription ( < 0.001). Simulated use of the CDS also led to overall improved guideline-adherent prescribing, with a 31% improvement for CAP. A trend was present toward absolute workload reduction. Using the NASA-TLX, workload scores for the current system were median 26, interquartile ranges (IQR): 11 to 41 versus median 25, and IQR: 10.5 to 39.5 for the CDS system ( = 0.117).

CONCLUSION:  Our CDS-enhanced discharge order set for ED antibiotic prescribing was strongly preferred by users, improved the accuracy of antibiotic prescribing, and trended toward reduced provider workload. The CDS was optimized for impact on guideline-adherent antibiotic prescribing from the ED and end-user acceptability to support future evaluative trials of ED ASPs.

10.1055/s-0042-1760082

Appl Clin Inform

36754066

Performance Feedback for Human Papillomavirus Vaccination: A Randomized Trial From the American Academy of Pediatrics Pediatric Research in Office Settings Research Network.

2023

47-56

12/2023

1876-2867

OBJECTIVE: To test the hypothesis that a feedback-based intervention would reduce human papillomavirus (HPV) vaccine missed opportunities.

METHODS: In a longitudinal cluster randomized controlled trial of 48 pediatric primary care practices, we allocated half the practices to receive a sequential, multicomponent intervention phased over consecutive periods. In a prior trial (period 1), communication skills training reduced missed opportunities for the initial HPV vaccine dose at well visits but not at acute/chronic visits. The current trial (period 2) evaluated the added value of performance feedback to clinicians after communication training. Performance feedback consisted of an introductory training module, weekly electronic "Quick Tips," and 3 individualized performance feedback reports to clinicians. We fit logistic regression models for the primary outcome of HPV vaccination missed opportunities using generalized estimating equations with independence working correlation, accounting for clustering at the practice level.

RESULTS: Performance feedback resulted in a 3.4 (95% confidence interval [CI]: -6.8, 0.0) percentage point greater reduction in missed HPV vaccine opportunities for the intervention versus control group during acute/chronic visits for subsequent HPV vaccinations (dose 2 or 3). However, during well visits for HPV vaccination dose #1, intervention practices increased missed opportunities (worsened) by 4.2 (95% CI: 1.0, 7.4) percentage points more than control practices, reducing the prior period 1 improvements and blunting the overall effect of performance feedback. We did not observe differences for the other visit/dose categories.

CONCLUSIONS: Performance feedback improved HPV vaccination for one subset of visits (acute/chronic, subsequent HPV vaccinations due), but not for well visits.

10.1016/j.acap.2022.07.006

Acad Pediatr

35853600

HPV Vaccinations at Acute Visits and Subsequent Adolescent Preventive Visits.

2022

12/2022

1098-4275

10.1542/peds.2022-058188

Pediatrics

36205071

Validation of the Pediatric Sequential Organ Failure Assessment Score and Evaluation of Third International Consensus Definitions for Sepsis and Septic Shock Definitions in the Pediatric Emergency Department.

2022

672-678

05/2022

2168-6211

Importance: Pediatric sepsis definitions have evolved, and some have proposed using the measure used in adults to quantify organ dysfunction, a Sequential Organ Failure Assessment (SOFA) score of 2 or more in the setting of suspected infection. A pediatric adaptation of SOFA (pSOFA) showed excellent discrimination for mortality in critically ill children but has not been evaluated in an emergency department (ED) population.

Objective: To delineate test characteristics of the pSOFA score for predicting in-hospital mortality among (1) all patients and (2) patients with suspected infection treated in pediatric EDs.

Design, Setting, and Participants: This retrospective cohort study took place from January 1, 2012, to January 31, 2020 in 9 US children's hospitals included in the Pediatric Emergency Care Applied Research Network (PECARN) Registry. The data was analyzed from February 1, 2020, to April 18, 2022. All ED visits for patients younger than 18 years were included.

Exposures: ED pSOFA score was assigned by summing maximum pSOFA organ dysfunction components during ED stay (each 0-4 points). In the subset with suspected infection, visit meeting criteria for sepsis (suspected infection with a pSOFA score of 2 or more) and septic shock (suspected infection with vasoactive infusion and serum lactate level >18.0 mg/dL) were identified.

Main Outcomes and Measures: Test characteristics of pSOFA scores of 2 or more during the ED stay for hospital mortality.

Results: A total of 3 999 528 (female, 47.3%) ED visits were included. pSOFA scores ranged from 0 to 16, with 126 250 visits (3.2%) having a pSOFA score of 2 or more. pSOFA scores of 2 or more had sensitivity of 0.65 (95% CI, 0.62-0.67) and specificity of 0.97 (95% CI, 0.97-0.97), with negative predictive value of 1.0 (95% CI, 1.00-1.00) in predicting hospital mortality. Of 642 868 patients with suspected infection (16.1%), 42 992 (6.7%) met criteria for sepsis, and 374 (0.1%) met criteria for septic shock. Hospital mortality rates for suspected infection (599 502), sepsis (42 992), and septic shock (374) were 0.0%, 0.9%, and 8.0%, respectively. The pSOFA score had similar discrimination for hospital mortality in all ED visits (area under receiver operating characteristic curve, 0.81; 95% CI, 0.79-0.82) and the subset with suspected infection (area under receiver operating characteristic curve, 0.82; 95% CI, 0.80-0.84).

Conclusions and Relevance: In a large, multicenter study of pediatric ED visits, a pSOFA score of 2 or more was uncommon and associated with increased hospital mortality yet had poor sensitivity as a screening tool for hospital mortality. Conversely, children with a pSOFA score of 2 or less were at very low risk of death, with high specificity and negative predictive value. Among patients with suspected infection, patients with pSOFA-defined septic shock demonstrated the highest mortality.

10.1001/jamapediatrics.2022.1301

JAMA Pediatr

35575803

Performance Feedback for Human Papillomavirus Vaccination: A Randomized Trial From the American Academy of Pediatrics Pediatric Research in Office Settings Research Network.

2022

07/2022

1876-2867

OBJECTIVE: To test the hypothesis that a feedback-based intervention would reduce human papillomavirus (HPV) vaccine missed opportunities.

METHODS: In a longitudinal cluster randomized controlled trial of 48 pediatric primary care practices, we allocated half the practices to receive a sequential, multicomponent intervention phased over consecutive periods. In a prior trial (period 1), communication skills training reduced missed opportunities for the initial HPV vaccine dose at well visits but not at acute/chronic visits. The current trial (period 2) evaluated the added value of performance feedback to clinicians after communication training. Performance feedback consisted of an introductory training module, weekly electronic "Quick Tips," and 3 individualized performance feedback reports to clinicians. We fit logistic regression models for the primary outcome of HPV vaccination missed opportunities using generalized estimating equations with independence working correlation, accounting for clustering at the practice level.

RESULTS: Performance feedback resulted in a 3.4 (95% confidence interval [CI]: -6.8, 0.0) percentage point greater reduction in missed HPV vaccine opportunities for the intervention versus control group during acute/chronic visits for subsequent HPV vaccinations (dose 2 or 3). However, during well visits for HPV vaccination dose #1, intervention practices increased missed opportunities (worsened) by 4.2 (95% CI: 1.0, 7.4) percentage points more than control practices, reducing the prior period 1 improvements and blunting the overall effect of performance feedback. We did not observe differences for the other visit/dose categories.

CONCLUSIONS: Performance feedback improved HPV vaccination for one subset of visits (acute/chronic, subsequent HPV vaccinations due), but not for well visits.

10.1016/j.acap.2022.07.006

Acad Pediatr

35853600