Learning Hierarchical Relational Representations through Relational Convolutions

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


View a PDF of the paper titled Learning Hierarchical Relational Representations through Relational Convolutions, by Awni Altabaa and 1 other authors

View PDF

Abstract:An evolving area of research in deep learning is the study of architectures and inductive biases that support the learning of relational feature representations. In this paper, we address the challenge of learning representations of hierarchical relations–that is, higher-order relational patterns among groups of objects. We introduce “relational convolutional networks”, a neural architecture equipped with computational mechanisms that capture progressively more complex relational features through the composition of simple modules. A key component of this framework is a novel operation that captures relational patterns in groups of objects by convolving graphlet filters–learnable templates of relational patterns–against subsets of the input. Composing relational convolutions gives rise to a deep architecture that learns representations of higher-order, hierarchical relations. We present the motivation and details of the architecture, together with a set of experiments to demonstrate how relational convolutional networks can provide an effective framework for modeling relational tasks that have hierarchical structure.

Submission history

From: Awni Altabaa [view email]
[v1]
Thu, 5 Oct 2023 01:22:50 UTC (2,246 KB)
[v2]
Tue, 20 Feb 2024 20:21:18 UTC (6,210 KB)
[v3]
Thu, 26 Sep 2024 22:45:29 UTC (8,847 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.