OBJECTIVE: To develop a summary format of clinical practice guideline (CPG) recommendations to improve understandability among health care professionals.

METHODS: We developed a summary format based on current research and used the "Think Aloud" technique in one-on-one cognitive interviews to iteratively improve it. Interviews of health care professionals from Children's Oncology Group-member, National Cancer Institute Community Oncology Research Program sites were conducted. After every five interviews (a round), responses were reviewed, and changes made to the format until it was well understood and no new, substantive suggestions for revision were raised. We took a directed (deductive) approach to content analysis of the interview notes to identify concerns related to recommendation summary usability, understandability, validity, applicability and visual appeal.

RESULTS: During seven rounds of interviews with 33 health care professionals, we identified important factors that influenced understandability. Participants found understanding weak recommendations more challenging than strong recommendations. Understanding was improved when the term 'conditional' recommendation was used instead of 'weak' recommendation. Participants found a Rationale section to be very helpful but desired more information when a recommendation entailed a practice change. In the final format, the recommendation strength is clearly indicated in the title, highlighted, and defined within a text box. The rationale for the recommendation is in a column on the left, with supporting evidence on the right. In a bulleted list, the Rationale section describes the benefits and harms and additional factors, such as implementation, that were considered by the CPG developers. Each bullet under the supporting evidence section indicates the level of evidence with an explanation and the supporting studies with hyperlinks when applicable.

CONCLUSIONS: A summary format to present strong and conditional recommendations was created through an iterative interview process. The format is straightforward, making it easy for organizations and CPG developers to use it to communicate recommendations clearly to intended users.

<p><strong>BACKGROUND: </strong>Clinical practice guideline (CPG)-consistent care improves patient outcomes, but CPG implementation is poor. Little is known about CPG implementation in pediatric oncology. This study aimed to understand supportive care CPG implementation facilitators and barriers at pediatric oncology National Cancer Institute (NCI) Community Oncology Research Program (NCORP) institutions.</p>

<p><strong>METHODS: </strong>Healthcare professionals at 26 pediatric, Children's&nbsp;Oncology&nbsp;Group-member, NCORP institutions were invited to participate in face-to-face focus groups. Serial focus groups were held until saturation of ideas was reached. Supportive care CPG implementation facilitators and barriers were solicited using nominal group technique (NGT), and implementation of specific supportive care CPG recommendations was discussed. Notes from each focus group were analyzed using a directed content analysis. The top five themes arising from an analysis of NGT items were identified, first from each focus group and then across all focus groups.</p>

<p><strong>RESULTS: </strong>Saturation of ideas was reached after seven focus groups involving 35 participants from 18 institutions. The top five facilitators of CPG implementation identified across all focus groups were organizational factors including charging teams with CPG implementation, individual factors including willingness to standardize care, user needs and values including mentorship, system factors including implementation structure, and implementation strategies including a basis in science. The top five barriers of CPG implementation identified were organizational factors including tolerance for inconsistencies, individual factors including lack of trust, system factors including administrative hurdles, user needs and values including lack of inclusivity, and professional including knowledge gaps.</p>

<p><strong>CONCLUSIONS: </strong>Healthcare professionals at pediatric NCORP institutions believe that organizational factors are the most important determinants of supportive care CPG implementation. They believe that CPG-consistent supportive care is most likely to be delivered in organizations that prioritize evidence-based care, provide structure and resources to implement CPGs, and eliminate implementation barriers.</p>

<p><strong>TRIAL REGISTRATION: </strong>ClinicalTrials.gov Identifier: NCT02847130. Date of registration: July 28, 2016.</p>