← sources

We stress-tested America.gov on night one with 15 questions from our own reporting. 9 correct, 6 incomplete, zero hallucinations.

source: reddit (reddit:artificial)published 2026-09-30 15:08ingested 2026-10-01 02:37

retained text

GSA launched America.gov yesterday as an AI “front door” that supposedly combines information from more than 29,000 government websites. The White House says you can ask any question and get an up-to-date answer.

We did not ask how to renew a passport.

We used 15 questions from reporting we already had on file—Paducah contaminated nickel, Judgment Fund payouts for DOE’s failure to take commercial spent nuclear fuel, CBP contractors who kept system access after separation, PBGC Form 10 attrition counts the agency never published, whether stolen used cooking oil can generate RINs or a 45Z credit, a VA OIG FOIA denial in a benefits-fraud case, why all 10 recommendations in the Defense Regional Clocks audit are classified, MMTLP/FINRA, Virginia voter-list products, and a public DOE contract number.

**Method**: We already knew the answer, knew there was no public answer, or had agency correspondence the system should not have. We scored correct / partial / incorrect / unsupported / blocked.

**Result**:  
•  9 correct  
•  6 substantially correct but incomplete  
•  0 fabricated answers we could identify

The useful finding was not the score. When America.gov did not know something, it generally stopped. One reply: “I cannot invent that number.”

**Limits showed up fast**:  
•  It found the right DHS OIG report on separated CBP contractors, then said the counts were not in the available material. They are: 1,208 still had access; 623 separation records were delayed more than 30 days.  
•  Nuclear-waste and spent-fuel figures were accurate but stale. Newer federal totals are higher.  
•  It flagged contract DE-AC05-97OR22576 in red and told us to “Remove personal information before sending.” That is a public DOE contract ID. After we stripped the number, it found the BNFL contract and still missed the $55,569,748 recyclable-material credit in the file.  
•  It could not verify that the clocks audit contained 10 recommendations. Oversight.gov lists them.  
•  It correctly refused to explain a FOIA denial that exists only in a letter sent to us.  
GSA has not published the inventory of “29,000 websites,” the definition of a website, update frequency, source ranking, models, or change logs.

We sent that inquiry last night.

Search still is not a records request. America.gov can tell you what the government has already posted. It cannot establish what the government has not. FOIA does that.

Full write-up, including the questions and scoring:  
https://bureaucracy.news/2026/09/30/we-asked-america-gov-15-questions-it-did-surprisingly-well/

Curious how this holds up on ordinary citizen questions versus research questions. Night one is not a full eval.

document fetched 2026-10-01 00:20 · canonical https://reddit.com/r/artificial/comments/1wu7f9w/we_stresstested_americagov_on_night_one_with_15