← sources

Private usage benchmark.

source: reddit (reddit:OpenAI)published 2026-09-19 13:01ingested 2026-09-20 02:37

retained text

I have my own 2year old benchmark. That I do on every model + I check the usage if possible.

Astra Extra High takes 10% was 2% at release.
Astra high 8% or 9% was 1%.
Astra Medium 8% was 1%
Astra Light 10% was about 1%.

What OpenAi is doing is fucked.

About the benchmark.
I have 60 short sentences in a file. And 600 video files. AIs need to match best videos to the sentences. They get all 600 names and they have to extract three 480p frames, first middle end frame if they think the name matches the sentence good. If they think video matches they put the name next to the short sentence. If not they check as much as they want.

It was good benchmark 2 years ago today this functionality is a given but, it tells me when a provider fucks my ass.

Edit:

xHigh 1h 37min

high 1h 17min

medium 1h 20min

light 1h30min

document fetched 2026-09-20 00:27 · canonical https://reddit.com/r/OpenAI/comments/1wklo0s/private_usage_benchmark