We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Artificial Intelligence & Machine Learning/Incorporating medical knowledge in BERT for clinical relation extraction
Conference ProceedingsArtificial Intelligence & Machine Learning

Incorporating medical knowledge in BERT for clinical relation extraction

Checking your access to this record.

Abstract & Overview

In recent years pre-trained language models (PLM) such as BERT have proven to be very effective in diverse NLP tasks such as Information Extraction, Sentiment Analysis and Question/Answering.Trained with massive generaldomain text, these pre-trained language models capture rich syntactic, semantic and discourse information in the text.However, due to the differences between general and specific domain text (e.g., Wikipedia text versus clinic notes), these models may not be ideal for domain-specific tasks (e.g., extracting clinical relations).Furthermore, it may require additional medical knowledge to understand clinical text properly.To solve these issues, in this research, we conduct a comprehensive examination of different techniques to add medical knowledge into a pre-trained BERT model for clinical relation extraction.Our best model outperformed the state-of-the-art systems on the benchmark i2b2/VA 2010 clinical relation extraction dataset.

Cite this record

Arpita Roy, Shimei Pan (2021). Incorporating medical knowledge in BERT for clinical relation extraction. Conference on Empirical Methods in Natural Language Processing (EMNLP). https://doi.org/10.18653/v1/2021.emnlp-main.435

Copy in another style

Roy, A., & Pan, S. (2021). Incorporating medical knowledge in BERT for clinical relation extraction. Conference on Empirical Methods in Natural Language Processing (EMNLP). https://doi.org/10.18653/v1/2021.emnlp-main.435
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.