<p><strong>PURPOSE: </strong>Reporting of adverse events (AEs) in clinical trials is critical to understanding treatment safety, but data on AE accuracy are limited. This study sought to determine the accuracy of AE reporting for pediatric acute myeloid leukemia clinical trials and to test whether an external electronic data source can improve reporting.</p>
<p><strong>METHODS: </strong>Reported AEs were evaluated on two trials, Children's Oncology Group AAML03P1 and AAML0531 arm B, with identical chemotherapy regimens but with different toxicity reporting requirements. Chart review for 12 AEs for patients enrolled in AAML0531 at 14 hospitals was the gold standard. The sensitivity and positive predictive values (PPV) of the AAML0531 AE report and AEs detected by review of Pediatric Health Information System (PHIS) billing and microbiology data were compared with chart data.</p>
<p><strong>RESULTS: </strong>Select AE rates from AAML03P1 and AAML0531 arm B differed significantly and correlated with the targeted toxicities of each trial. Chart abstraction was performed on 204 patients (758 courses) on AAML0531. AE report sensitivity was < 50% for eight AEs, but PPV was > 75% for six AEs. AE reports for viridans group streptococcal bacteremia, a targeted toxicity on AAML0531, had a sensitivity of 78.3% and PPV of 98.1%. PHIS billing data had higher sensitivity (> 50% for nine AEs), but lower PPV (< 75% for 10 AEs). Viridans group streptococcal detection using PHIS microbiology data had high sensitivity (92.3%) and PPV (97.3%).</p>
<p><strong>CONCLUSION: </strong>The current system of AE reporting for cooperative oncology group clinical trials in pediatric acute myeloid leukemia underestimates AE rates. The high sensitivity and PPV of PHIS microbiology data suggest that using external data sources may improve the accuracy of AE reporting.</p>
<p><strong>BACKGROUND: </strong>Recently investigators have used analysis of administrative/billing datasets to answer clinical and pharmacoepidemiology questions in pediatric oncology. However, the accuracy of pharmacy data from administrative/billing datasets have not yet been evaluated. The primary objective of this study was to determine the concordance of Pediatric Health Information System (PHIS) administrative/billing chemotherapy data with Children's Oncology Group (COG) protocol-mandated chemotherapy and to assess the implications of this level of concordance for further PHIS research.</p>
<p><strong>PROCEDURE: </strong>Data from 384 pediatric patients (1,060 courses of chemotherapy) with acute myeloid leukemia treated on COG clinical trial AAML0531 were previously merged with PHIS data. PHIS chemotherapy administrative/billing data were reviewed for the first three courses of chemotherapy. Accuracy was assessed using three metrics: recognizability of chemotherapy pattern by course, chemotherapy administration pattern by individual medication, and concordance with the number of days of protocol-defined chemotherapy.</p>
<p><strong>RESULTS: </strong>The chemotherapy pattern was recognizable in 87.3% of courses when course-wide accuracy was assessed. Chemotherapy administration pattern varied by medication. Cytarabine had perfect concordance 70.9% of the time, daunorubicin had perfect concordance 77.4% of the time, and etoposide had perfect concordance 67.8% of the time.</p>
<p><strong>CONCLUSIONS: </strong>The accuracy of chemotherapy administrative/billing data supports the continued use of PHIS data for epidemiology studies as long as investigators perform data quality control checks and evaluate each specific medication prior to undertaking definitive analyses.</p>