ModelsAgree

Open dataset

Every poll we've ever run, unedited

Don't take our rankings on trust — audit them. This is the append-only history behind every leaderboard on this site: every answer ChatGPT, Claude, Gemini and Grok have given us, timestamped, failures included, nothing overwritten or filtered.

12,770

poll answers

1,430

categories

2026-06-25 →

2026-07-15

3.5 MB

zipped JSONL

Download the dataset (3.5 MB zip)

CC BY 4.0 — use it for anything, cite modelsagree.com

What's inside

  • polls-devtools.jsonl 7,143 records · software / dev tools / crypto ranking polls
  • polls-gear-opinions.jsonl 5,534 records · consumer gear + opinion polls
  • polls-claude-variants.jsonl 93 records · Claude Haiku/Sonnet/Opus variant comparison polls

Schema

tsISO timestamp the answer was received
asked_atdate the poll batch was launched
slugcategory id — matches modelsagree.com/best/<slug>
type“ranked” (top-5 list) · “pick” (single best) · “verdict”
questionthe exact question asked
modelChatGPT · Claude · Gemini · Grok
pickthe model's #1 answer (null on failure)
rankedthe model's full ranked list, first = best
reasonthe model's verbatim one-line reasoning
errerror text when a poll failed — kept, we don't cherry-pick

Read this before citing it

These are answers from the consumer surfaces of each model, one fresh session per question, at whatever settings each product ships — we don't control temperature, which is exactly why each category is re-polled weekly and the full time series is published. A single answer is noise; the repeated record is the signal. This dataset measures what AI assistants recommend — not independent product testing — and that matters because millions of people now ask assistants what to use. Full protocol on the methodology page, including the verbatim prompt template.