3.8 Proceedings Paper

Continuous Prompt Enhanced Biomedical Entity Normalization

Publisher

SPRINGER INTERNATIONAL PUBLISHING AG
DOI: 10.1007/978-3-031-17189-5_5

Keywords

Prompt-BEN; Prompt learning; Contrastive loss

Ask authors/readers for more resources

This paper proposes a framework called Prompt-BEN that enhances biomedical entity normalization using continuous prompts. The method fine-tunes only a few parameters and utilizes embeddings with continuous prefix prompts to capture semantic similarity. It also designs a contrastive loss with a synonym marginalized strategy for the BEN task. Experimental results demonstrate that the method achieves competitive or even greater linking accuracy compared to state-of-the-art fine-tuning-based models while having about 600 times fewer tuned parameters.
Biomedical entity normalization (BEN) aims to link the entity mentions in a biomedical text to referent entities in a knowledge base. Recently, the paradigm of large-scale language model pre-training and fine-tuning have achieved superior performance in BEN task. However, pre-trained language models like SAPBERT [21] typically contain hundreds of millions of parameters, and fine-tuning all parameters is computationally expensive. The latest research such as prompt technology is proposed to reduce the amount of parameters during the model training. Therefore, we propose a framework Prompt-BEN using continuous Prompt to enhance BEN, which just needs to fine-tune few parameters of prompt. Our method employs embeddings with the continuous prefix prompt to capture the semantic similarity between mention and terms. We also design a contrastive loss with synonym marginalized strategy for the BEN task. Finally, experimental results on three benchmark datasets demonstrated that our method achieves competitive or even greater linking accuracy than the state-of-the-art fine-tuning-based models while having about 600 times fewer tuned parameters.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

3.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available