CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search

How to Evaluate an LLM's Ability to Follow Instructions


View a PDF of the paper titled CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search, by Fengran Mo and 6 other authors

View PDF
HTML (experimental)

Abstract:In this paper, we study how open-source large language models (LLMs) can be effectively deployed for improving query rewriting in conversational search, especially for ambiguous queries. We introduce CHIQ, a two-step method that leverages the capabilities of LLMs to resolve ambiguities in the conversation history before query rewriting. This approach contrasts with prior studies that predominantly use closed-source LLMs to directly generate search queries from conversation history. We demonstrate on five well-established benchmarks that CHIQ leads to state-of-the-art results across most settings, showing highly competitive performances with systems leveraging closed-source LLMs. Our study provides a first step towards leveraging open-source LLMs in conversational search, as a competitive alternative to the prevailing reliance on commercial LLMs. Data, models, and source code will be publicly available upon acceptance at this https URL.

Submission history

From: Fengran Mo [view email]
[v1]
Fri, 7 Jun 2024 15:23:53 UTC (7,101 KB)
[v2]
Thu, 26 Sep 2024 06:19:34 UTC (7,102 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.