First name
Aaron
Middle name
J
Last name
Masino

Title

Evaluating commercially available wireless cardiovascular monitors for measuring and transmitting real-time physiological responses in children with autism.

Year of Publication

2021

Date Published

2021 Nov 06

ISSN Number

1939-3806

Abstract

<p>Commercially available wearable biosensors have the potential to enhance psychophysiology research and digital health technologies for autism by enabling stress or arousal monitoring in naturalistic settings. However, such monitors may not be comfortable for children with autism due to sensory sensitivities. To determine the feasibility of wearable technology in children with autism age 8-12 years, we first selected six consumer-grade wireless cardiovascular monitors and tested them during rest and movement conditions in 23 typically developing adults. Subsequently, the best performing monitors (based on data quality robustness statistics), Polar and Mio Fuse, were evaluated in 32 children with autism and 23 typically developing children during a 2-h session, including rest and mild stress-inducing tasks. Cardiovascular data were recorded simultaneously across monitors using custom software. We administered the Comfort Rating Scales to children. Although the Polar monitor was less comfortable for children with autism than typically developing children, absolute scores demonstrated that, on average, all children found each monitor comfortable. For most children, data from the Mio Fuse (96%-100%) and Polar (83%-96%) passed quality thresholds of data robustness. Moreover, in the stress relative to rest condition, heart rate increased for the Polar, F(1,53)&nbsp;=&nbsp;135.70, p &lt; 0.001, ηp &nbsp;=&nbsp;0.78, and Mio Fuse, F(1,53)&nbsp;=&nbsp;71.98, p &lt; 0.001, ηp &nbsp;=&nbsp;0.61, respectively, and heart rate variability decreased for the Polar, F(1,53)&nbsp;=&nbsp;13.41, p&nbsp;=&nbsp;0.001, ηp &nbsp;=&nbsp;0.26, and Mio Fuse, F(1,53)&nbsp;=&nbsp;8.89, p&nbsp;=&nbsp;0.005, ηp &nbsp;=&nbsp;0.16, respectively. This feasibility study suggests that select consumer-grade wearable cardiovascular monitors can be used with children with autism and may be a promising means for tracking physiological stress or arousal responses in community settings. LAY SUMMARY: Commercially available heart rate trackers have the potential to advance stress research with individuals with autism. Due to sensory sensitivities common in autism, their comfort wearing such trackers is vital to gathering robust and valid data. After assessing six trackers with typically developing adults, we tested the best trackers (based on data quality) in typically developing children and children with autism and found that two of them met criteria for comfort, robustness, and validity.</p>

DOI

10.1002/aur.2633

Alternate Title

Autism Res

PMID

34741438

Title

Perspective on the Development of a Large-Scale Clinical Data Repository for Pediatric Hearing Research.

Year of Publication

2020

Number of Pages

231-238

Date Published

2020 Mar/Apr

ISSN Number

1538-4667

Abstract

<p>The use of "big data" for pediatric hearing research requires new approaches to both data collection and research methods. The widespread deployment of electronic health record systems creates new opportunities and corresponding challenges in the secondary use of large volumes of audiological and medical data. Opportunities include cost-effective hypothesis generation, rapid cohort expansion for rare conditions, and observational studies based on sample sizes in the thousands to tens of thousands. Challenges include finding and forming appropriately skilled teams, access to data, data quality assessment, and engagement with a research community new to big data. The authors share their experience and perspective on the work required to build and validate a pediatric hearing research database that integrates clinical data for over 185,000 patients from the electronic health record systems of three major academic medical centers.</p>

DOI

10.1097/AUD.0000000000000779

Alternate Title

Ear Hear

PMID

31408044

Title

Aiding clinical assessment of neonatal sepsis using hematological analyzer data with machine learning techniques.

Year of Publication

2021

Date Published

2021 May 04

ISSN Number

1751-553X

Abstract

<p><strong>INTRODUCTION: </strong>Early diagnosis and antibiotic administration are essential for reducing sepsis morbidity and mortality; however, diagnosis remains difficult due to complex pathogenesis and presentation. We created a machine learning model for bacterial sepsis identification in the neonatal intensive care unit (NICU) using hematological analyzer data.</p>

<p><strong>METHODS: </strong>Hematological analyzer data were gathered from NICU patients up to 48&nbsp;hours prior to clinical evaluation for bacterial sepsis. Five models, Support Vector Machine, K-nearest-neighbors, Logistic Regression, Random Forest (RF), and Extreme Gradient boosting (XGBoost), were trained on 60 hematological and nine clinical variables for 2357 cases (1692 control, 665 septic). Clinical feature only models (nine variables) were additionally trained and compared with models including hematological variables. Feature importance was used to assess relative contributions of parameters to performance.</p>

<p><strong>RESULTS: </strong>The three best performing models were RF, Logistic Regression, and XGBoost. RF achieved an average accuracy of 0.74, AUC-ROC of 0.73, Sensitivity of 0.38, and Specificity of 0.88. Logistic Regression achieved an average accuracy of 0.70, AUC-ROC of 0.74, Sensitivity of 0.62, and Specificity of 0.73. XGBoost achieved an average accuracy of 0.72, AUC-ROC of 0.71, Sensitivity of 0.40, and Specificity of 0.85. All models with hematological variables had significantly stronger performance than models trained on only clinical features. Neutrophil parameters had the highest average feature importance.</p>

<p><strong>CONCLUSIONS: </strong>Machine learning models using hematological analyzer data can classify NICU patients as sepsis positive or negative with stronger performance compared to clinical feature only models. Hematological analyzer variables could augment current sepsis classification machine learning algorithms.</p>

DOI

10.1111/ijlh.13549

Alternate Title

Int J Lab Hematol

PMID

33949115

Title

Prediction of early childhood obesity with machine learning and electronic health record data.

Year of Publication

2021

Number of Pages

104454

Date Published

2021 Apr 09

ISSN Number

1872-8243

Abstract

<p><strong>OBJECTIVE: </strong>This study compares seven machine learning models developed to predict childhood obesity from age &gt; 2 to ≤ 7 years using Electronic Healthcare Record (EHR) data up to age 2 years.</p>

<p><strong>MATERIALS AND METHODS: </strong>EHR data from of 860,510 patients with 11,194,579 healthcare encounters were obtained from the Children's Hospital of Philadelphia. After applying stringent quality control to remove implausible growth values and including only individuals with all recommended wellness visits by age 7 years, 27,203 (50.78 % male) patients remained for model development. Seven machine learning models were developed to predict obesity incidence as defined by the Centers for Disease Control and Prevention (age/sex adjusted BMI&gt;95th percentile). Model performance was evaluated by multiple standard classifier metrics and the differences among seven models were compared using the Cochran's Q test and post-hoc pairwise testing.</p>

<p><strong>RESULTS: </strong>XGBoost yielded 0.81 (0.001) AUC, which outperformed all other models. It also achieved statistically significant better performance than all other models on standard classifier metrics (sensitivity fixed at 80 %): precision 30.90 % (0.22 %), F1-socre 44.60 % (0.26 %), accuracy 66.14 % (0.41 %), and specificity 63.27 % (0.41 %).</p>

<p><strong>DISCUSSION AND CONCLUSION: </strong>Early childhood obesity prediction models were developed from the largest cohort reported to date. Relative to prior research, our models generalize to include males and females in a single model and extend the time frame for obesity incidence prediction to 7 years of age. The presented machine learning model development workflow can be adapted to various EHR-based studies and may be valuable for developing other clinical prediction models.</p>

DOI

10.1016/j.ijmedinf.2021.104454

Alternate Title

Int J Med Inform

PMID

33866231

Title

Personalized prediction of early childhood asthma persistence: A machine learning approach.

Year of Publication

2021

Number of Pages

e0247784

Date Published

2021

ISSN Number

1932-6203

Abstract

<p>Early childhood asthma diagnosis is common; however, many children diagnosed before age 5 experience symptom resolution and it remains difficult to identify individuals whose symptoms will persist. Our objective was to develop machine learning models to identify which individuals diagnosed with asthma before age 5 continue to experience asthma-related visits. We curated a retrospective dataset for 9,934 children derived from electronic health record (EHR) data. We trained five machine learning models to differentiate individuals without subsequent asthma-related visits (transient diagnosis) from those with asthma-related visits between ages 5 and 10 (persistent diagnosis) given clinical information up to age 5 years. Based on average NPV-Specificity area (ANSA), all models performed significantly better than random chance, with XGBoost obtaining the best performance (0.43 mean ANSA). Feature importance analysis indicated age of last asthma diagnosis under 5 years, total number of asthma related visits, self-identified black race, allergic rhinitis, and eczema as important features. Although our models appear to perform well, a lack of prior models utilizing a large number of features to predict individual persistence makes direct comparison infeasible. However, feature importance analysis indicates our models are consistent with prior research indicating diagnosis age and prior health service utilization as important predictors of persistent asthma. We therefore find that machine learning models can predict which individuals will experience persistent asthma with good performance and may be useful to guide clinician and parental decisions regarding asthma counselling in early childhood.</p>

DOI

10.1371/journal.pone.0247784

Alternate Title

PLoS One

PMID

33647071

Title

Neonatal sepsis registry: Time to antibiotic dataset.

Year of Publication

2019

Number of Pages

104788

Date Published

2019 Dec

ISSN Number

2352-3409

Abstract

<p>This article describes the process of extracting electronic health record (EHR) data into a format that supports analyses related to the timeliness of antibiotic administration. The de-identified data that accompanies this article were collected from a cohort of infants who were evaluated for possible sepsis in the Neonatal Intensive Care Unit (NICU) at the Children's Hospital of Philadelphia (CHOP). The interpretation of findings from these data are reported in a separate manuscript [1]. For purposes of illustration for interested readers, scripts written in the R programming language related to the creation and use of the dataset have also been provided. Interested researchers are encouraged to contact the research team to discuss opportunities for collaboration.</p>

DOI

10.1016/j.dib.2019.104788

Alternate Title

Data Brief

PMID

31799346

Title

Duration of preoperative clear fluid fasting and peripheral intravenous catheterization in children: a single-center observational cohort study of 9,693 patients.

Year of Publication

2019

Date Published

2019 Nov 30

ISSN Number

1460-9592

Abstract

<p><strong>BACKGROUND: </strong>Children routinely undergo inhalational induction of general anesthesia. Intravenous line placement typically occurs after induction of anesthesia and can be challenging, particularly in infants and young children.</p>

<p><strong>AIMS: </strong>We conducted a retrospective observational study to determine whether there was an association between clear liquid fasting time and the number of peripheral intravenous catheter insertion attempts in anesthetized children. The secondary aim was to identify factors associated with multiple attempts to insert intravenous lines.</p>

<p><strong>METHODS: </strong>After institutional research board approval, we retrieved a data set of all children between 0 months and 18 years who received general anesthesia at our hospital between January 1, 2016, and September 30, 2017. Data included age, gender, weight, race, ASA status, gestational age, number of peripheral intravenous catheter insertion attempts, any assistive device for insertion, and insertion site. Inclusion criteria were mask induction, ASA status 1 or 2, non-emergency, ambulatory surgical procedures and placement of a single intravenous line during the anesthetic.</p>

<p><strong>RESULTS: </strong>9,693 patients were included in the study. 8,869 patients required one insertion attempt and 824 underwent multiple insertion attempts. 50% of patients in the single insertion attempt group had clear liquid fasting time less than 6.9 hours compared to 51.8% of patients requiring multiple attempts. Logistic regression model adjusted for age, ASA status, gender and BMI did not find an association between duration of clear liquid fasting time and rate of multiple insertion attempts for intravenous catheters (OR 0.99, 95% CI 0.98-1.01, P = 0.47).</p>

<p><strong>CONCLUSIONS: </strong>Clear liquid fasting time was not associated with multiple insertion attempts for intravenous line insertion in children receiving general anesthesia. Factors such as patient age, ethnicity, time of day of induction of anesthesia and American Society of Anesthesiologists Physical Status classification show a greater association with the risk of multiple intravenous line insertion attempts.</p>

DOI

10.1111/pan.13777

Alternate Title

Paediatr Anaesth

PMID

31785039

Title

Surviving Sepsis in a Referral Neonatal Intensive Care Unit: Association between Time to Antibiotic Administration and In-Hospital Outcomes.

Year of Publication

2019

Date Published

2019 Oct 08

ISSN Number

1097-6833

Abstract

<p><strong>OBJECTIVE: </strong>To determine if time to antibiotic administration is associated with mortality and in-hospital outcomes in a neonatal intensive care unit (NICU) population.</p>

<p><strong>STUDY DESIGN: </strong>We conducted a prospective evaluation of infants with suspected sepsis between September 2014 and February 2018; sepsis was defined as clinical concern prompting blood culture collection and antibiotic administration. Time to antibiotic administration was calculated from time of sepsis identification, defined as the order time of either blood culture or an antibiotic, to time of first antibiotic administration. We used linear models with generalized estimating equations to determine the association between time to antibiotic administration and mortality, ventilator-free and inotrope-free days, and NICU length of stay in patients with culture-proven sepsis.</p>

<p><strong>RESULTS: </strong>Among 1946 sepsis evaluations, we identified 128 episodes of culture-proven sepsis in 113 infants. Among them, prolonged time to antibiotic administration was associated with significantly increased risk of mortality at 14&nbsp;days (OR, 1.47; 95% CI, 1.15-1.87) and 30&nbsp;days (OR, 1.47; 95% CI, 1.11-1.94) as well as fewer inotrope-free days (incidence rate ratio, 0.91; 95% CI, 0.84-0.98). No significant associations with ventilator-free days or NICU length of stay were demonstrated.</p>

<p><strong>CONCLUSIONS: </strong>Among infants with sepsis, delayed time to antibiotic administration was an independent risk factor for death and prolonged cardiovascular dysfunction. Further study is needed to define optimal timing of antimicrobial administration in high-risk NICU populations.</p>

DOI

10.1016/j.jpeds.2019.08.023

Alternate Title

J. Pediatr.

PMID

31604632

Title

Machine learning models for early sepsis recognition in the neonatal intensive care unit using readily available electronic health record data.

Year of Publication

2019

Number of Pages

e0212665

Date Published

2019

ISSN Number

1932-6203

Abstract

<p><strong>BACKGROUND: </strong>Rapid antibiotic administration is known to improve sepsis outcomes, however early diagnosis remains challenging due to complex presentation. Our objective was to develop a model using readily available electronic health record (EHR) data capable of recognizing infant sepsis at least 4 hours prior to clinical recognition.</p>

<p><strong>METHODS AND FINDINGS: </strong>We performed a retrospective case control study of infants hospitalized ≥48 hours in the Neonatal Intensive Care Unit (NICU) at the Children's Hospital of Philadelphia between September 2014 and November 2017 who received at least one sepsis evaluation before 12 months of age. We considered two evaluation outcomes as cases: culture positive-positive blood culture for a known pathogen (110 evaluations); and clinically positive-negative cultures but antibiotics administered for ≥120 hours (265 evaluations). Case data was taken from the 44-hour window ending 4 hours prior to evaluation. We randomly sampled 1,100 44-hour windows of control data from all times ≥10 days removed from any evaluation. Model inputs consisted of up to 36 features derived from routine EHR data. Using 10-fold nested cross-validation, 8 machine learning models were trained to classify inputs as sepsis positive or negative. When tasked with discriminating culture positive cases from controls, 6 models achieved a mean area under the receiver operating characteristic (AUC) between 0.80-0.82 with no significant differences between them. Including both culture and clinically positive cases, the same 6 models achieved an AUC between 0.85-0.87, again with no significant differences.</p>

<p><strong>CONCLUSIONS: </strong>Machine learning models can identify infants with sepsis in the NICU hours prior to clinical recognition. Learning curves indicate model improvement may be achieved with additional training examples. Additional input features may also improve performance. Further research is warranted to assess potential performance improvements and clinical efficacy in a prospective trial.</p>

DOI

10.1371/journal.pone.0212665

Alternate Title

PLoS ONE

PMID

30794638

Title

Temporal bone radiology report classification using open source machine learning and natural langue processing libraries.

Year of Publication

2016

Number of Pages

65

Date Published

2016 Jun 06

ISSN Number

1472-6947

Abstract

<p><strong>BACKGROUND: </strong>Radiology reports are a rich resource for biomedical research. Prior to utilization, trained experts must manually review reports to identify discrete outcomes. The Audiological and Genetic Database (AudGenDB) is a public, de-identified research database that contains over 16,000 radiology reports. Because the reports are unlabeled, it is difficult to select those with specific abnormalities. We implemented a classification pipeline using a human-in-the-loop machine learning approach and open source libraries to label the reports with one or more of four abnormality region labels: inner, middle, outer, and mastoid, indicating the presence of an abnormality in the specified ear region.</p>

<p><strong>METHODS: </strong>Trained abstractors labeled radiology reports taken from AudGenDB to form a gold standard. These were split into training (80&nbsp;%) and test (20&nbsp;%) sets. We applied open source libraries to normalize and convert every report to an n-gram feature vector. We trained logistic regression, support vector machine (linear and Gaussian), decision tree, random forest, and naïve Bayes models for each ear region. The models were evaluated on the hold-out test set.</p>

<p><strong>RESULTS: </strong>Our gold-standard data set contained 726 reports. The best classifiers were linear support vector machine for inner and outer ear, logistic regression for middle ear, and decision tree for mastoid. Classifier test set accuracy was 90&nbsp;%, 90&nbsp;%, 93&nbsp;%, and 82&nbsp;% for the inner, middle, outer and mastoid regions, respectively. The logistic regression method was very consistent, achieving accuracy scores within 2.75&nbsp;% of the best classifier across regions and a receiver operator characteristic area under the curve of 0.92 or greater across all regions.</p>

<p><strong>CONCLUSIONS: </strong>Our results indicate that the applied methods achieve accuracy scores sufficient to support our objective of extracting discrete features from radiology reports to enhance cohort identification in AudGenDB. The models described here are available in several free, open source libraries that make them more accessible and simplify their utilization as demonstrated in this work. We additionally implemented the models as a web service that accepts radiology report text in an HTTP request and provides the predicted region labels. This service has been used to label the reports in AudGenDB and is freely available.</p>

DOI

10.1186/s12911-016-0306-3

Alternate Title

BMC Med Inform Decis Mak

PMID

27267768

WATCH THIS PAGE

Subscription is not available for this page.