← sources

If regenerating an answer changes the facts, none of the versions were facts

source: reddit (reddit:ChatGPT)published 2026-09-25 10:07ingested 2026-09-26 02:35

retained text

I asked ChatGPT when a law in my field took effect. Got a year, stated flat. Hit regenerate out of habit and got a different year, also stated flat. Third try, a third year.

Each one on its own would have convinced me. It's only side by side that you see it was never looking anything up, it was producing a plausible year each time.

That's the whole trick now for anything factual that matters. Same answer three times, it probably knows. Different answers, it's guessing, and it will never tell you which one you got.

Doing it in one message is faster than clicking regenerate:

Answer this three separate times, as if you had not seen your other answers. Then list every point where the three disagree.

The disagreements are the useful part. Where the three match I mostly trust it. Where they split, that's what I go check myself.

For numbers and dates, one more line helps:

Give me a range instead of a single value, and tell me what the range depends on.

A confident single number is the format that hides a guess best.

Worth knowing: this catches guessing, not shared mistakes. If it learned something wrong it'll repeat the same wrong thing three times. So agreement is a good sign, not proof.

I keep the three-times prompt saved in AI Toolbox, the Chrome extension I build for ChatGPT, since it's the one I run before trusting anything with a date in it.

document fetched 2026-09-26 00:20 · canonical https://reddit.com/r/ChatGPT/comments/1wpsess/if_regenerating_an_answer_changes_the_facts_none