GNNBoost: boosting artwork classification with graph embeddings

Feb 1, 2025·
Cheikh Brahim El Vaigh
,
Noa Garcia
,
Benjamin Renoust
,
Chenhui Chu
,
Yuta Nakashima
,
Yiming Qian
,
Hajime Nagahara
· 0 min read
Abstract
The use of AI systems for managing large-scale cultural heritage artifacts has become possible due to the rise of digitization. To classify such content, machine learning is typically used, where contextual information is important to structure the data. One way to capture context is through a knowledge graph. In this study, we propose a newd graph neural networks, we can improve artwork classification by utilizing the relationships between entities of the knowledge graph. Our experiments demonstrate that this approach achieves state-of-the-art results on multiple classification tasks across three datasets (SemArt paintings, Buddha statues, and Ukiyo-e woodblock prints). Moreover, our approach is effective in dealing with unbalanced data and we explore the use of both graph attention mechanisms and focal loss functions.
Type
Publication
Multimedia Tools and Applications