GNNBoost: boosting artwork classification with graph embeddings

2月 1, 2025·
Cheikh Brahim El Vaigh
,
Noa Garcia
,
Benjamin Renoust
,
Chenhui Chu
,
Yuta Nakashima
,
Yiming Qian
,
Hajime Nagahara
· 0 分で読める
概要
The use of AI systems for managing large-scale cultural heritage artifacts has become possible due to the rise of digitization. To classify such content, machine learning is typically used, where contextual information is important to structure the data. One way to capture context is through a knowledge graph. In this study, we propose a newd graph neural networks, we can improve artwork classification by utilizing the relationships between entities of the knowledge graph. Our experiments demonstrate that this approach achieves state-of-the-art results on multiple classification tasks across three datasets (SemArt paintings, Buddha statues, and Ukiyo-e woodblock prints). Moreover, our approach is effective in dealing with unbalanced data and we explore the use of both graph attention mechanisms and focal loss functions.
タイプ
収録
Multimedia Tools and Applications