Has Opus 5.5 Been Nerfed? LiveNerf Update: Day 38
retained text
Over a month ago, we began a quest in trying to answer a simple question: Does model performance degrade silently without the user being aware of this change? We’re now 38 days into collecting data through LiveNerf’s methodology, so far, no degradation has been detected. We’re able to detect a 7% change or more as of now but I’m aiming to get that to under 1% for Fable 5.5, not a promise, just a goal. If you’re interested in tracking model performance of Opus 5.5, here’s the repo: [https://github.com/ninjahawk/livenerf](https://github.com/ninjahawk/livenerf) To do that, it would require 44x as much data to be collected, and we’re already consuming one pro plan per week for the data being collected. I’m trying to organize a group of people who’d be willing to join as contributors as we expand, I should be making a Google form within a few days which will be posted to the discord. It wouldn’t be technical at all, the idea is that for us to secure enough accuracy in v2 of LiveNerf we’ll need a much larger amount of compute to ensure data accuracy. I’m very thankful to everyone for everything, I would’ve never expected for us to already be at over 1,600 stars on Github. You’re all awesome. I’m hoping to bring a level of transparency that consumer plans and enterprise systems currently lack in AI.
document fetched 2026-11-01 00:22 · canonical https://reddit.com/r/ClaudeAI/comments/1xkdxwo/has_opus_55_been_nerfed_livenerf_update_day_38