Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection

Ya Gao, Shaoxiong Ji, Pekka Marttinen


Abstract
Adverse drug events (ADEs) are an important aspect of drug safety. Various texts such as biomedical literature, drug reviews, and user posts on social media and medical forums contain a wealth of information about ADEs. Recent studies have applied word embedding and deep learning-based natural language processing to automate ADE detection from text. However, they did not explore incorporating explicit medical knowledge about drugs and adverse reactions or the corresponding feature learning. This paper adopts the heterogeneous text graph, which describes relationships between documents, words, and concepts, augments it with medical knowledge from the Unified Medical Language System, and proposes a concept-aware attention mechanism that learns features differently for the different types of nodes in the graph. We further utilize contextualized embeddings from pretrained language models and convolutional graph neural networks for effective feature representation and relational learning. Experiments on four public datasets show that our model performs competitively to the recent advances, and the concept-aware attention consistently outperforms other attention mechanisms.
Anthology ID:
2024.lrec-main.855
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
9787–9798
Language:
URL:
https://aclanthology.org/2024.lrec-main.855
DOI:
Bibkey:
Cite (ACL):
Ya Gao, Shaoxiong Ji, and Pekka Marttinen. 2024. Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 9787–9798, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection (Gao et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.855.pdf