Returning integrated genomic risk and clinical recommendations: The eMERGE study.

2023

100006

04/2023

1530-0366

PURPOSE: Assessing the risk of common, complex diseases requires consideration of clinical risk factors as well as monogenic and polygenic risks, which in turn may be reflected in family history. Returning risks to individuals and providers may influence preventive care or use of prophylactic therapies for those individuals at high genetic risk.

METHODS: To enable integrated genetic risk assessment, the eMERGE (electronic MEdical Records and GEnomics) network is enrolling 25,000 diverse individuals in a prospective cohort study across 10 sites. The network developed methods to return cross-ancestry polygenic risk scores, monogenic risks, family history, and clinical risk assessments via a genome-informed risk assessment (GIRA) report and will assess uptake of care recommendations after return of results.

RESULTS: GIRAs include summary care recommendations for 11 conditions, education pages, and clinical laboratory reports. The return of high-risk GIRA to individuals and providers includes guidelines for care and lifestyle recommendations. Assembling the GIRA required infrastructure and workflows for ingesting and presenting content from multiple sources. Recruitment began in February 2022.

CONCLUSION: Return of a novel report for communicating monogenic, polygenic, and family history-based risk factors will inform the benefits of integrated genetic risk assessment for routine health care.

10.1016/j.gim.2023.100006

Genet Med

36621880

A Clinical Decision Support System for Motivational Messaging and Tobacco Cessation Treatment for Parents: Pilot Evaluation of Use and Acceptance.

2023

03/2023

1869-0327

BACKGROUND: Research is needed to identify how clinical decision support (CDS) systems can support communication about and engagement with tobacco use treatment in pediatric settings for parents who smoke. We developed a CDS system that identifies parents who smoke, delivers motivational messages to start treatment, connects parents to treatment, and supports pediatrician-parent discussion.

OBJECTIVE: To assess the performance of this system in clinical practice, including receipt of motivational messages and tobacco use treatment acceptance rates.

METHODS: The system was evaluated at one large pediatric practice through a single-arm pilot study from June-November 2021. We collected data on the performance of the CDS system for all parents. Additionally, we surveyed a sample of parents immediately after the clinical encounter who used the system and reported smoking. Measures were: 1) the parent remembered the motivational message, 2) the pediatrician reinforced the message, and 3) treatment acceptance rates. Treatments included nicotine replacement therapy, quitline referral (phone counseling), and/or SmokefreeTXT referral (text-message counseling). We described survey response rates overall and with 95% confidence intervals (CI).

RESULTS: During the entire study period, 8488 parents completed use of the CDS: 9.3% (n=786) reported smoking, and 48.2% (n=379) accepted at least one treatment. One hundred and two parents who smoke who used the system were approached to survey 100 parents (98% response rate). Most parents self-identified as female (84%), aged 25-34 years (56%), and Black/African American (94%), and had children with Medicaid insurance (95%). Of parents surveyed, 54% accepted at least one treatment option. Most parents recalled the motivational message (79%; 95% CI: 71-87%), and 31% (95% CI: 19-44%) reported the pediatrician reinforced the motivational message.

CONCLUSION: A CDS system to support parental tobacco use treatment in pediatric primary care enhanced motivational messaging about smoking cessation and evidence-based treatment initiation.

10.1055/a-2062-9627

Appl Clin Inform

36972687

A Clinical Decision Support System for Motivational Messaging and Tobacco Cessation Treatment for Parents: Pilot Evaluation of Use and Acceptance.

2023

03/2023

1869-0327

BACKGROUND: Research is needed to identify how clinical decision support (CDS) systems can support communication about and engagement with tobacco use treatment in pediatric settings for parents who smoke. We developed a CDS system that identifies parents who smoke, delivers motivational messages to start treatment, connects parents to treatment, and supports pediatrician-parent discussion.

OBJECTIVE: To assess the performance of this system in clinical practice, including receipt of motivational messages and tobacco use treatment acceptance rates.

METHODS: The system was evaluated at one large pediatric practice through a single-arm pilot study from June-November 2021. We collected data on the performance of the CDS system for all parents. Additionally, we surveyed a sample of parents immediately after the clinical encounter who used the system and reported smoking. Measures were: 1) the parent remembered the motivational message, 2) the pediatrician reinforced the message, and 3) treatment acceptance rates. Treatments included nicotine replacement therapy, quitline referral (phone counseling), and/or SmokefreeTXT referral (text-message counseling). We described survey response rates overall and with 95% confidence intervals (CI).

RESULTS: During the entire study period, 8488 parents completed use of the CDS: 9.3% (n=786) reported smoking, and 48.2% (n=379) accepted at least one treatment. One hundred and two parents who smoke who used the system were approached to survey 100 parents (98% response rate). Most parents self-identified as female (84%), aged 25-34 years (56%), and Black/African American (94%), and had children with Medicaid insurance (95%). Of parents surveyed, 54% accepted at least one treatment option. Most parents recalled the motivational message (79%; 95% CI: 71-87%), and 31% (95% CI: 19-44%) reported the pediatrician reinforced the motivational message.

CONCLUSION: A CDS system to support parental tobacco use treatment in pediatric primary care enhanced motivational messaging about smoking cessation and evidence-based treatment initiation.

10.1055/a-2062-9627

Appl Clin Inform

36972687

Provider perspectives on clinical decision support to improve HIV prevention in pediatric primary care: a multiple methods study.

2023

18

02/2023

2662-2211

BACKGROUND: Clinical decision support (CDS) is a promising intervention for improving uptake of HIV testing and pre-exposure prophylaxis (PrEP). However, little is known regarding provider perspectives on acceptability, appropriateness, and feasibility of CDS for HIV prevention in pediatric primary care, a key implementation setting.

METHODS: This was a cross-sectional multiple methods study utilizing surveys and in-depth interviews with pediatricians to assess acceptability, appropriateness, and feasibility of CDS for HIV prevention, as well as to identify contextual barriers and facilitators to CDS. Qualitative analysis utilized work domain analysis and a deductive coding approach grounded in the Consolidated Framework of Implementation Research. Quantitative and qualitative data were merged to develop an Implementation Research Logic Model to conceptualize implementation determinants, strategies, mechanisms, and outcomes of potential CDS use.

RESULTS: Participants (n = 26) were primarily white (92%), female (88%), and physicians (73%). Using CDS to improve HIV testing and PrEP delivery was perceived as highly acceptable (median score 5), IQR [4-5]), appropriate (5, IQR [4-5]), and feasible (4, IQR [3.75-4.75]) using a 5-point Likert scale. Providers identified confidentiality and time constraints as two key barriers to HIV prevention care spanning every workflow step. With respect to desired CDS features, providers sought interventions that were integrated into the primary care workflow, standardized to promote universal testing yet adaptable to the level of a patient's HIV risk, and addressed providers' knowledge gaps and bolstered self-efficacy in providing HIV prevention services.

CONCLUSIONS: This multiple methods study indicates that clinical decision support in the pediatric primary care setting may be an acceptable, feasible, and appropriate intervention for improving the reach and equitable delivery of HIV screening and PrEP services. Design considerations for CDS in this setting should include deploying CDS interventions early in the visit workflow and prioritizing standardized but flexible designs.

10.1186/s43058-023-00394-7

Implement Sci Commun

36810099

Human-centered development of an electronic health record-embedded, interactive information visualization in the emergency department using fast healthcare interoperability resources.

2021

2021 Mar 03

1527-974X

<p><strong>OBJECTIVE: </strong>Develop and evaluate an interactive information visualization embedded within the electronic health record (EHR) by following human-centered design (HCD) processes and leveraging modern health information exchange standards.</p>

<p><strong>MATERIALS AND METHODS: </strong>We applied an HCD process to develop a Fast Healthcare Interoperability Resources (FHIR) application that displays a patient's asthma history to clinicians in a pediatric emergency department. We performed a preimplementation comparative system evaluation to measure time on task, number of screens, information retrieval accuracy, cognitive load, user satisfaction, and perceived utility and usefulness. Application usage and system functionality were assessed using application logs and a postimplementation survey of end users.</p>

<p><strong>RESULTS: </strong>Usability testing of the Asthma Timeline Application demonstrated a statistically significant reduction in time on task (P &lt; .001), number of screens (P &lt; .001), and cognitive load (P &lt; .001) for clinicians when compared to base EHR functionality. Postimplementation evaluation demonstrated reliable functionality and high user satisfaction.</p>

<p><strong>DISCUSSION: </strong>Following HCD processes to develop an application in the context of clinical operations/quality improvement is feasible. Our work also highlights the potential benefits and challenges associated with using internationally recognized data exchange standards as currently implemented.</p>

<p><strong>CONCLUSION: </strong>Compared to standard EHR functionality, our visualization increased clinician efficiency when reviewing the charts of pediatric asthma patients. Application development efforts in an operational context should leverage existing health information exchange standards, such as FHIR, and evidence-based mixed methods approaches.</p>

10.1093/jamia/ocab016

J Am Med Inform Assoc

33682004

Formative Usability Testing Reduces Severe Blood Product Ordering Errors.

2019

981-990

2019 Oct

1869-0327

<p><strong>BACKGROUND: </strong> Medical errors in blood product orders and administration are common, especially for pediatric patients. A failure modes and effects analysis in our health care system indicated high risk from the electronic blood ordering process.</p>

<p><strong>OBJECTIVES: </strong> There are two objectives of this study as follows:(1) To describe differences in the design of the original blood product orders and order sets in the system (original design), new orders and order sets designed by expert committee (DEC), and a third-version developed through user-centered design (UCD).(2) To compare the number and type of ordering errors, task completion rates, time on task, and user preferences between the original design and that developed via UCD.</p>

<p><strong>METHODS: </strong> A multidisciplinary expert committee proposed adjustments to existing blood product order sets resulting in the DEC order set. When that order set was tested with front-line users, persistent failure modes were detected, so orders and order sets were redesigned again via formative usability testing. Front-line users in their native clinical workspaces were observed ordering blood in realistic simulated scenarios using a think-aloud protocol. Iterative adjustments were made between participants. In summative testing, participants were randomized to use the original design or UCD for five simulated scenarios. We evaluated differences in ordering errors, time on task, and users' design preference with two-sample -tests.</p>

<p><strong>RESULTS: </strong> Formative usability testing with 27 providers from seven specialties led to 18 changes made to the DEC to produce the UCD. In summative testing, error-free task completion for the original design was 36%, which increased to 66% in UCD (30%, 95% confidence interval [CI]: 3.9-57%;  = 0.03). Time on task did not vary significantly.</p>

<p><strong>CONCLUSION: </strong> UCD led to substantially different blood product orders and order sets than DEC. Users made fewer errors when ordering blood products for pediatric patients in simulated scenarios when using the UCD orders and order sets compared with the original design.</p>

10.1055/s-0039-3402714

Appl Clin Inform

31875648

A Heuristic Evaluation to Assess Use of After Visit Summaries for Supporting Continuity of Care.

2018

714-724

2018 07

1869-0327

<p><strong>BACKGROUND: </strong>Outpatient providers often do not receive discharge summaries from acute care providers prior to follow-up visits. These outpatient providers may use the after-visit summaries (AVS) that are given to patients to obtain clinical information. It is unclear how effectively AVS support care coordination between clinicians.</p>

<p><strong>OBJECTIVES: </strong>Goals for this effort include: (1) developing usability heuristics that may be applied both for assessment and to guide generation of medical documents in general, (2) conducting a heuristic evaluation to assess the use of AVS for communication between clinicians, and (3) providing recommendations for generating AVS that effectively support both patient/caregiver use and care coordination.</p>

<p><strong>METHODS: </strong>We created a 17-item heuristic evaluation instrument for assessing usability of medical documents. Eight experts used the instrument to assess each of four simulated AVS. The simulations were created using examples from two hospitals and two pediatric patient cases developed by the National Institute of Standards and Technology.</p>

<p><strong>RESULTS: </strong>Experts identified 224 unique usability problems ranging in severity from mild to catastrophic. Content issues (e.g., missing medical history, marital status of a 2-year-old) were rated as most severe, but widespread formatting and structural problems (e.g., inconsistent indentation, fonts, and headings; confusing ordering of information) were so distracting that they significantly reduced readers' ability to efficiently use the documents. Overall, issues in the AVS from Hospital 2 were more severe than those in the AVS from Hospital 1.</p>

<p><strong>CONCLUSION: </strong>The new instrument allowed for quick, inexpensive evaluations of AVS. Usability issues such as unnecessary information, poor organization, missing information, and inconsistent formatting make it hard for patients, caregivers, and clinicians to use the AVS. The heuristics in the new instrument may be used as guidance to adapt electronic health record systems so that they generate more useful and usable medical documents.</p>

10.1055/s-0038-1668093

Appl Clin Inform

30208496

Development and dissemination of clinical decision support across institutions: standardization and sharing of refugee health screening modules.

2019

2019 Aug 02

1527-974X

<p><strong>OBJECTIVES: </strong>We developed and piloted a process for sharing guideline-based clinical decision support (CDS) across institutions, using health screening of newly arrived refugees as a case example.</p>

<p><strong>MATERIALS AND METHODS: </strong>We developed CDS to support care of newly arrived refugees through a systematic process including a needs assessment, a 2-phase cognitive task analysis, structured preimplementation testing, local implementation, and staged dissemination. We sought consensus from prospective users on CDS scope, applicable content, basic supported workflows, and final structure. We documented processes and developed sharable artifacts from each phase of development. We publically shared CDS artifacts through online dissemination platforms. We collected feedback and implementation data from implementation sites.</p>

<p><strong>RESULTS: </strong>Responses from 19 organizations demonstrated a need for improved CDS for newly arrived refugee patients. A guided multicenter workflow analysis identified 2 main workflows used by organizations that would need to be supported by shared CDS. We developed CDS through an iterative design process, which was successfully disseminated to other sites using online dissemination repositories. Implementation sites had a small-to-modest analyst time commitment but reported a good match between CDS and workflow.</p>

<p><strong>CONCLUSION: </strong>Sharing of CDS requires overcoming technical and workflow barriers. We used a guided multicenter workflow analysis and online dissemination repositories to create flexible CDS that has been adapted at 3 sites. Organizations looking to develop sharable CDS should consider evaluating the workflows of multiple institutions and collecting feedback on scope, design, and content in order to make a more generalizable product.</p>

10.1093/jamia/ocz124

J Am Med Inform Assoc

31373356

Identifying Electronic Health Record Usability And Safety Challenges In Pediatric Settings.

2018

1752-1759

2018 11

1544-5208

<p>Pediatric populations are uniquely vulnerable to the usability and safety challenges of electronic health records (EHRs), particularly those related to medication, yet little is known about the specific issues contributing to hazards. To understand specific usability issues and medication errors in the care of children, we analyzed 9,000 patient safety reports, made in the period 2012-17, from three different health care institutions that were likely related to EHR use. Of the 9,000 reports, 3,243 (36&nbsp;percent) had a usability issue that contributed to the medication event, and 609 (18.8&nbsp;percent) of the 3,243 might have resulted in patient harm. The general pattern of usability challenges and medication errors were the same across the three sites. The most common usability challenges were associated with system feedback and the visual display. The most common medication error was improper dosing.</p>

10.1377/hlthaff.2018.0699

Health Aff (Millwood)

30395517

Adoption of a Portal for the Primary Care Management of Pediatric Asthma: A Mixed-Methods Implementation Study.

2016

e172

2016

1438-8871

<p><strong>BACKGROUND: </strong>Patient portals may improve communication between families of children with asthma and their primary care providers and improve outcomes. However, the feasibility of using portals to collect patient-reported outcomes from families and the barriers and facilitators of portal implementation across diverse pediatric primary care settings have not been established.</p>

<p><strong>OBJECTIVE: </strong>We evaluated the feasibility of using a patient portal for pediatric asthma in primary care, its impact on management, and barriers and facilitators of implementation success.</p>

<p><strong>METHODS: </strong>We conducted a mixed-methods implementation study in 20 practices (11 states). Using the portal, parents of children with asthma aged 6-12 years completed monthly surveys to communicate treatment concerns, treatment goals, symptom control, medication use, and side effects. We used logistic regression to evaluate the association of portal use with child characteristics and changes to asthma management. Ten clinician focus groups and 22 semistructured parent interviews explored barriers and facilitators of use in the context of an evidence-based implementation framework.</p>

<p><strong>RESULTS: </strong>We invited 9133 families to enroll and 237 (2.59%) used the portal (range by practice, 0.6%-13.6%). Children of parents or guardians who used the portal were significantly more likely than nonusers to be aged 6-9 years (vs 10-12, P=.02), have mild or moderate/severe persistent asthma (P=.009 and P=.04), have a prescription of a controller medication (P&lt;.001), and have private insurance (P=.002). Portal users with uncontrolled asthma had significantly more medication changes and primary care asthma visits after using the portal relative to the year earlier (increases of 14% and 16%, respectively). Qualitative results revealed the importance of practice organization (coordinated workflows) as well as family (asthma severity) and innovation (facilitated communication and ease of use) characteristics for implementation success.</p>

<p><strong>CONCLUSIONS: </strong>Although use was associated with higher treatment engagement, our results suggest that achieving widespread portal adoption is unlikely in the short term. Implementation efforts should include workflow redesign and prioritize enrollment of symptomatic children.</p>

<p><strong>CLINICALTRIAL: </strong>Clinicaltrials.gov NCT01966068; https://clinicaltrials.gov/ct2/show/NCT01966068 (Archived by WebCite at http://www.webcitation.org/6i9iSQkm3).</p>

10.2196/jmir.5610

J. Med. Internet Res.

27357835