Title

Natural language processing (NLP) tools in extracting biomedical concepts from research articles: a case study on autism spectrum disorder.

Year of Publication

2020

Number of Pages

322

Date Published

2020 Dec 30

ISSN Number

1472-6947

Abstract

<p><strong>BACKGROUND: </strong>Natural language processing (NLP) tools can facilitate the extraction of biomedical concepts from unstructured free texts, such as research articles or clinical notes. The NLP software tools CLAMP, cTAKES, and MetaMap are among the most widely used tools to extract biomedical concept entities. However, their performance in extracting disease-specific terminology from literature has not been compared extensively, especially for complex neuropsychiatric disorders with a diverse set of phenotypic and clinical manifestations.</p>

<p><strong>METHODS: </strong>We comparatively evaluated these NLP tools using autism spectrum disorder (ASD) as a case study. We collected 827 ASD-related terms based on previous literature as the benchmark list for performance evaluation. Then, we applied&nbsp;CLAMP, cTAKES, and MetaMap on 544 full-text articles and 20,408 abstracts from PubMed to extract&nbsp;ASD-related terms. We evaluated the predictive performance using precision, recall, and F1 score.</p>

<p><strong>RESULTS: </strong>We found that CLAMP has the best performance in terms of F1 score followed by cTAKES and then MetaMap. Our results show that CLAMP has much higher precision than cTAKES and MetaMap, while cTAKES and MetaMap have higher recall than CLAMP.</p>

<p><strong>CONCLUSION: </strong>The analysis protocols used in this study can be applied to other neuropsychiatric or neurodevelopmental disorders that lack well-defined terminology sets to describe their phenotypic presentations.</p>

DOI

10.1186/s12911-020-01352-2

Alternate Title

BMC Med Inform Decis Mak

PMID

33380331

WATCH THIS PAGE

Subscription is not available for this page.