TY - GEN
T1 - LM-Based Word Embeddings Improve Biomedical Named Entity Recognition
T2 - 8th International Work-Conference on Bioinformatics and Biomedical Engineering, IWBBIO 2020
AU - Akhtyamova, Liliya
AU - Cardiff, John
N1 - Publisher Copyright:
© Springer Nature Switzerland AG 2020.
PY - 2020
Y1 - 2020
N2 - Recent studies have shown that contextualized word embeddings outperform other types of embeddings on a variety of tasks. However, there is little research done to evaluate their effectiveness in the biomedical domain under multi-task settings. We derive the contextualized word embeddings from the Flair framework and apply them to the task of biomedical NER on 5 benchmark datasets, yielding major improvements over the baseline and achieving competitive results over the current best systems. We analyze the sources of these improvements, reporting model performances over different combinations of word embeddings, and fine-tuning and casing modes.
AB - Recent studies have shown that contextualized word embeddings outperform other types of embeddings on a variety of tasks. However, there is little research done to evaluate their effectiveness in the biomedical domain under multi-task settings. We derive the contextualized word embeddings from the Flair framework and apply them to the task of biomedical NER on 5 benchmark datasets, yielding major improvements over the baseline and achieving competitive results over the current best systems. We analyze the sources of these improvements, reporting model performances over different combinations of word embeddings, and fine-tuning and casing modes.
KW - Biomedical named entity recognition
KW - Contextualized word embeddings
KW - Deep learning
UR - https://www.scopus.com/pages/publications/85085039321
U2 - 10.1007/978-3-030-45385-5_56
DO - 10.1007/978-3-030-45385-5_56
M3 - Conference contribution
AN - SCOPUS:85085039321
SN - 9783030453848
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 624
EP - 635
BT - Bioinformatics and Biomedical Engineering - 8th International Work-Conference, IWBBIO 2020, Proceedings
A2 - Rojas, Ignacio
A2 - Valenzuela, Olga
A2 - Rojas, Fernando
A2 - Herrera, Luis Javier
A2 - Ortuño, Francisco
PB - Springer
Y2 - 6 May 2020 through 8 May 2020
ER -