23
May
A challenge of building AI applications is choosing which model to use. What if we don’t have to? What if we can predict the best model for any prompt? Predictive human preference aims to predict which model users might prefer for a specific query. Table of contents Ranking Models Using Human Preference…. How Preferential Ranking Works…. Correctness of Chatbot Arena Ranking…….. Eval data…….. ResultsPredicting Human Preference For Each Prompt…. Experiment setup…. Experiment results…….. Domain-specific and query-specific leaderboardsConclusion Human preference has emerged to be both the Northstar and a powerful tool for AI model development. Human preference guides post-training techniques including…