We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Artificial Intelligence & Machine Learning/MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER
Conference ProceedingsArtificial Intelligence & Machine Learning

MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER

Checking your access to this record.

Abstract & Overview

Data augmentation is an effective solution to data scarcity in low-resource scenarios.However, when applied to token-level tasks such as NER, data augmentation methods often suffer from token-label misalignment, which leads to unsatsifactory performance.In this work, we propose Masked Entity Language Modeling (MELM) as a novel data augmentation framework for low-resource NER.To alleviate the token-label misalignment issue, we explicitly inject NER labels into sentence context, and thus the fine-tuned MELM is able to predict masked entity tokens by explicitly conditioning on their labels.Thereby, MELM generates high-quality augmented data with novel entities, which provides rich entity regularity knowledge and boosts NER performance.When training data from multiple languages are available, we also integrate MELM with codemixing for further improvement.We demonstrate the effectiveness of MELM on monolingual, cross-lingual and multilingual NER across various low-resource levels.Experimental results show that our MELM presents substantial improvement over the baseline methods. 1

Cite this record

Zhou Ran, Xin Yan Li, Ruidan He, Lidong Bing, Erik Cambria, Luo Si, et al. (2022). MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER. Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2022.acl-long.160

Copy in another style

Ran, Z., Li, X. Y., He, R., Bing, L., Cambria, E., Si, L., & Miao, C. (2022). MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER. Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2022.acl-long.160
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.