GNNBoost: boosting artwork classification with graph embeddings
Feb 1, 2025·,,,,,,·
0 min read
Cheikh Brahim El Vaigh
Noa Garcia
Benjamin Renoust
Chenhui Chu
Yuta Nakashima
Yiming Qian
Hajime Nagahara
Abstract
The use of AI systems for managing large-scale cultural heritage artifacts has become possible due to the rise of digitization. To classify such content, machine learning is typically used, where contextual information is important to structure the data. One way to capture context is through a knowledge graph. In this study, we propose a newd graph neural networks, we can improve artwork classification by utilizing the relationships between entities of the knowledge graph. Our experiments demonstrate that this approach achieves state-of-the-art results on multiple classification tasks across three datasets (SemArt paintings, Buddha statues, and Ukiyo-e woodblock prints). Moreover, our approach is effective in dealing with unbalanced data and we explore the use of both graph attention mechanisms and focal loss functions.
Type
Publication
Multimedia Tools and Applications