← sources

Artificial Analysis Index is non-representative of real-world performance. Tested Kimi 3.1 Pro through OpenRouter, the number 4 model in AAI, it's not even close to MiMo 2.6 or DeepSeek 4.1 Flash

source: reddit (reddit:singularity)published 2026-10-25 03:04ingested 2026-10-26 02:38

retained text

It seems Artificial Analysis Index is very easy to game, Kimi 3.1 Pro #4 on AAI is super bad in real world use cases, not even close to DeepSeek 4.1 Flash.

document fetched 2026-10-26 00:29 · canonical https://reddit.com/r/singularity/comments/1xerbxx/artificial_analysis_index_is_nonrepresentative_of