ClaimVer: Explainable Claim-Level Verification and Evidence Attribution of Text Through Knowledge Graphs

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


View a PDF of the paper titled ClaimVer: Explainable Claim-Level Verification and Evidence Attribution of Text Through Knowledge Graphs, by Preetam Prabhu Srikar Dammu and 6 other authors

View PDF
HTML (experimental)

Abstract:In the midst of widespread misinformation and disinformation through social media and the proliferation of AI-generated texts, it has become increasingly difficult for people to validate and trust information they encounter. Many fact-checking approaches and tools have been developed, but they often lack appropriate explainability or granularity to be useful in various contexts. A text validation method that is easy to use, accessible, and can perform fine-grained evidence attribution has become crucial. More importantly, building user trust in such a method requires presenting the rationale behind each prediction, as research shows this significantly influences people’s belief in automated systems. Localizing and bringing users’ attention to the specific problematic content is also paramount, instead of providing simple blanket labels. In this paper, we present ClaimVer, a human-centric framework tailored to meet users’ informational and verification needs by generating rich annotations and thereby reducing cognitive load. Designed to deliver comprehensive evaluations of texts, it highlights each claim, verifies it against a trusted knowledge graph (KG), presents the evidence, and provides succinct, clear explanations for each claim prediction. Finally, our framework introduces an attribution score, enhancing applicability across a wide range of downstream tasks.

Submission history

From: Aman Chadha Mr. [view email]
[v1]
Tue, 12 Mar 2024 17:07:53 UTC (548 KB)
[v2]
Mon, 24 Jun 2024 01:08:24 UTC (773 KB)
[v3]
Wed, 21 Aug 2024 02:45:15 UTC (993 KB)
[v4]
Sat, 21 Sep 2024 03:26:40 UTC (993 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.