The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


View a PDF of the paper titled The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories, by Xi Yu Huang and Krishnapriya Vishnubhotla and Frank Rudzicz

View PDF
HTML (experimental)

Abstract:The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ from human storytelling. We augment the Reddit WritingPrompts dataset with short stories generated by GPT-3.5, given the same prompts. We quantify and compare the emotional and descriptive features of storytelling from both generative processes, human and machine, along a set of six dimensions. We find that generated stories differ significantly from human stories along all six dimensions, and that human and machine generations display similar biases when grouped according to the narrative point-of-view and gender of the main protagonist. We release our dataset and code at this https URL.

Submission history

From: Krishnapriya Vishnubhotla [view email]
[v1]
Mon, 24 Jun 2024 16:24:18 UTC (465 KB)
[v2]
Mon, 25 Nov 2024 01:13:12 UTC (7,841 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.