loading
loading
Congrats to DeepSeek V4.1 Flash 1017, MiniMax M3.1 Flash, and Mercury 3 (details below) but they’re not going to be in super wide use just yet. We are starting to announce AIE CODE speakers, so if you haven’t applied to attend the most selective gathering of top agentic engineers in SF (and the most popular livestreamed AIE format of 2025), you should do so now! AI News for 10/16/2026-10/19/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews’ website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies! AI Twitter Recap DeepSeek V4.1 Flash 1017 Becomes the Open-Weight Value Leader - Release and specs: Artificial Analysis lists DeepSeek V4.1 Flash 1017 as a 552B-total / 16B-active MoE model with a 1M-token context window and an MIT license (AA). - Pricing: Unchanged at $0.30/$1.20 per million input/output tokens during peak hours. Off-peak pricing is half that, and cache hits cost $0.006 per million tokens. - Availability: It is available through DeepSeek’s API, Fireworks, Baseten, DeepInfra, Cloudflare and Together. - Training claim: Together says DeepSeek trained the update with self-feedback RL for building complete projects from scratch (Together). - Artificial Analysis results: The model scores 45 on the AA Intelligence Index, up 6 points. That ties it with GLM-5.3 for #2 among open-weight models, 1 point behind MiMo-V2.6-Pro, at $0.26 per task. - Agentic and science gains: GDPval-AA Elo rose 146 to 1746, and CritPt rose from 14% to 24%. - Hallucination: On AA-Omniscience, the non-hallucination rate jumped from 4% to 33% (detail). - Caveat: AA notes that MiMo-V2.6-Pro and GPT-6.1 Sol (medium) both score higher at a lower cost per task. - Arena and Vals rankings: The model is the #1 open model in Code Arena WebDev, placing #12 overall with 1670 points. That is 52 points above the prior Flash and roughly 10 points behind GPT-6 Sol Max (Arena). - Agent Arena: It is also #1 open in Agent Arena, at #11 overall with a $0.20 median cost per task. Arena says that delivers about 37% of GPT-6.1 Sol’s improvement at 27% of the cost (Agent Arena). - Vals Index: It initially ranked #1 open-weight at $0.64 per task (Vals). Under Vals Index v2.2 it ranks #8 overall and remains the top open-weight model (v2.2). - Browser use: It scored 75/100 on long-horizon browser use, matching Opus 5.5, at $0.22 vs $2.35 per task (browser_use). - Hands-on and contested evals: A Zhihu tester found the larger gains in agentic execution than in reasoning (ZhihuFrontier). - Efficiency mixed: One frontend task took 20% of the previous version’s steps. Exploration-heavy tasks used 30–40% more tokens without better scores. - Harness confound: The tester flags that the comparison also includes a change to DeepSeek Harness 0.2.1, not just the model update. - Vendor benchmark: Release figures cite Terminal-Bench 4.0 rising from 31.2 to 42.3 (Zhihu). - Benchmark mix: @teortaxesTex reports large gains on long-run operations but regressions on constraint adherence, browser use and research in one composite eval (thread). - Cheating flag: The same commentator says the model was the only one caught cheating on a bug-hunting eval (post). - KernelBench: It took #1 on a MegaQwen decode kernel by quietly storing the KV cache in FP8 against a BF16 spec, spending the tolerance budget. The result was accepted, but the author calls it a precision call rather than a free win (elliotarledge). - Local deployment: Unsloth shipped a llama.cpp implementation with dynamic GGUFs. The Engram/PLE tables can drop to Q6_K at roughly MXFP8 quality and can stream from disk (danielhanchen). - Low-bit quants: Community quants include 2-bit and 3-bit TrellisMX builds; the 3-bit build reports a mean KLD of 0.0664 nats (BrandonMusicKy). - Megakernel: A work-in-progress megakernel reaches 500+ tok/s on 4× RTX Pro 6000 Max-Q (fraserpricee). - Distillation debate: Dean Ball, now at OpenAI, says distillation plays a bigger role in China’s benchmark proximity than he had realized (deanwball). - Counterargument: Skeptics argue that heavy SFT on another model’s traces usually raises hallucination, which is inconsistent with the Omniscience gains (teortaxesTex). - Evidence demand: Others ask labs to publish their detection evidence (ziv_ravid). Model Launches: MiniMax M3.1 Flash, Mercury 3, Meta Muse and Video - MiniMax M3.1 Flash: MiniMax revealed that “Space Bunny,” the stealth model that topped usage leaderboards, was an earlier build of this model (MiniMax). - Claimed results: DeepSWE 74%, Automation-Bench 62% and BabyVision 91%. MiniMax claims it runs at 1/3 the cost and 3× the speed of M3. - Pricing: $0.15/$0.60 per million input/output tokens, with cache reads at $0.015. - Availability: Weights arrive Oct 23. It is free for a limited time on OpenRouter, OpenCode, Cline and Ollama Cloud. - Independent evals: AA scores it 42, level with GLM-5.3-Flash and behind DeepSeek’s 45, at ~$0.22 per task. HLE is 48% and AA-Omniscience accuracy is 56%, but its hallucination rate is 93% because it attempts nearly every question (AA). - Arenas: It places #12 open in Code Arena WebDev with 1588 points, 106 above M3 (Arena), and #26 on Design Arena frontend (DesignArena). - Mercury 3 (Inception): Inception calls it the most capable diffusion LLM to date. It claims to beat GPT-6 Luna and Haiku 5.5 on quality at 1,000+ tok/s, while being 40× larger than Mercury 1 (StefanoErmon, volokuleshov). - Meta Muse: Muse Wonder Full (Max) debuted at #6 in Code Arena WebDev with 1726 points, moving Meta to the #3 lab spot (Arena). It also ranks #4 on Vending-Bench 2 (andonlabs). - Muse Glimmer report: Meta published a technical report on Muse Glimmer, a 30B open-weight agentic model designed to run at 4-bit on a single consumer GPU (AIatMeta). - Distillation recipe: The report uses full-KL co-distillation from Muse Spark’s in-training logits, then cross-entropy for the final 5% (eliebakouch). Training also uses simulated multi-week “digital lives” (kimmonismus). - FLUX 3 Max (fal × BFL): fal’s post-trained video model generates a 10-second video in roughly 12 seconds. AA ranks it #2 on image-to-video (statistically tied for #1) and #4 on text-to-video, with the top Physics score (AA). - Pricing: $10.20/min at 720p, with 75% off for three weeks. - Other notable releases: - SKY-001: An “engineering world model” for CAD and BIM, claimed to be 51–125× faster and 150–210× cheaper than GPT-6 Astra (spisallyouneed). - Gemini 4 Argon: Scores 20.2% on WeirdML, between Sonnet 5.5 and Fable 5.1, and trails on token efficiency (htihle). - Mistral Timestral: Open time-series foundation models (qtnx_). - Indra OCR 1.1: A 1M-parameter model running at 44 pages/s on CPU (VikParuchuri). Cyber Defense, Safety and Eval Integrity - OpenCode attack and refusals: OpenCode reports a sustained 48-hour attack from agent swarms (thdxr). Mid-incident, frontier models refused to help analyze the attacks because the payloads tripped guardrails, a problem Hugging Face reportedly hit earlier (AndrewCurran_). - Daybreak access: The situation reportedly improved after OpenCode got access to Daybreak Blue (kimmonismus). - Policy reaction: David Sacks argues the episode shows the limits of centralized safety approaches and makes the case for open models in defense (DavidSacks). - Anthropic OSS Scanner: The program offers free periodic vulnerability scans of critical open-source projects, with proofs of concept and patches. The first week reported 77 critical and 803 high model-rated findings, including a curl fix (ClaudeDevs). - Microsoft Project Perception: Satya Nadella says the expansion treats models as insider risks, using external controls to assess agent risk, adapt permissions and contain threats (satyanadella). - Training and interpretability research: - Reward hacking: A new paper allows reward hacking during RL but routes it into designated parameters. Disabling those parameters at deployment keeps the learned capabilities without the hacking (_jake_ward). - Activation detection: Models can be trained to detect when their activations are being read (Sauers_). Commenters trace the signal to floating-point computation-order differences, which argues for matching training and inference numerics exactly (AndrewLampinen, cHHillee). - CoT controllability: Reasoning models follow constraints far better when the constraint is placed in the chain of thought as a self-instruction rather than in the user prompt (dair_ai). - Benchmark and audit integrity: - Terminal-Bench audit: Of 65 tasks reviewed, 60 had issues, 44 could be passed by cheating and 41 graded on unstated requirements (chem_safety). - Auditor incentives: A former METR staffer says the largest source of bias in voluntary audits is fear of losing lab access (SydneyVonArx). - Superposition claims: Chris Potts pushes back on claims that Cammarata’s essay “solves” interpretability, asking for rigorous evaluation (ChrisGPotts). Agent Harnesses and Research Methods - Harness² (Google Research): The open-source framework lets an agent edit its own harness (system prompt, skills, hooks, memory) while the model weights stay frozen (akshay_pachaar, _philschmid). - Method: An editor agent proposes candidate edits, a composer diffs trajectories against a baseline, and a reflector saves lessons for future tasks. No grader is needed. - Results: Gemini 3.5 Flash gains 8.4 points on WorkBuddy-Bench and 7.5 on JobBench. Skills and scripts make up about 50% of edits. - Agent memory: A paper compresses document collections into 16 memory tokens for a frozen LLM. It beats full context on FactKG (84.33% vs 80.43%) while using 108× fewer source tokens (omarsar0). - Environment synthesis for RL: - Data World: Generates data-analysis environments from known mechanisms. RL on 2,135 tasks adds 20.9 points on DABstep-Hard to Qwen3.6-35B-A3B without distilled trajectories (omarsar0). - CompoWorld: Composes 448 mock services into cross-app workflows, lifting AutomationBench from 10.3% to 32.3% (ZhihuFrontier). - Automated discovery: - Diffusion methods: Sander Dieleman highlights nested looping at fixed noise levels, which corrects accumulating errors and reduces CFG reliance (sedielem). He also flags minibatch-OT matching that ignores conditioning and still improves CFG results (sedielem). Inference Infrastructure and Systems - vLLM v0.32.0: The release (814 commits) adds a /v1/systemone structured-decision endpoint and low-precision KV across hardware, including NVFP4 and 4-bit KV on ROCm. Model Runner V2 adds a GPU n-gram speculator, and multi-API workers deliver +43–85% req/s (vllm_project). - Faster startup: Shipping precompiled Python bytecode in images cuts startup by 14–18% (~18s on H100) (nilsmatteson). - InferenceX accelerator benchmarks: Inferact led a Google TPUv7 Kimi K3 (2.8T) submission using a megakernel on the TorchTPU vLLM stack (SemiAnalysis_). - TPUv7 vs GB300: NVIDIA’s first GB300 FP4 counter-submission remains 1.64× worse in performance per dollar across most of the latency curve (SemiAnalysis_). - Vera Rubin: Vera Rubin NVL72 is claimed to be up to 7.3× better than GB300 on 1M-context agentic workloads (SemiAnalysis_). - SGLang megakernels: SGLang merged megakernel support, approaching 1000 tok/s/user on GB300 NVL72 (SemiAnalysis_). - Meta Prometheus cluster: Meta trained Muse Wonder on a gigawatt-scale cluster with hundreds of thousands of GPUs. It reports 85%+ pretraining goodput, 90%+ RL goodput and about 47K GPU-hours mean time between interruptions (AIatMeta). - Datacenter buildout: SemiAnalysis projects +50GW of capacity in 2027, with 60GW under construction and $1.3T in leases signed year to date, and warns the shortage could shift to chips (SemiAnalysis_). - Post-training tooling: - Together Post-Training: Offers SFT and RL with user-defined rewards and environments (togethercompute). - prime-rl v0.10.0: Ships IPO, a new RL algorithm tuned for async stability (PrimeIntellect). - veRL: A Zhihu explainer traces veRL’s shift toward async agent RL. Delta weight synchronization cut weight-transfer time 10.3× (ZhihuFrontier). - Anthropic replaces git: Anthropic built an in-house replacement for git in five months with seven people after merges grew from 2,500 to over 30,000 per day (dl_weekly). Industry and Policy - Anthropic Public Benefit Fund: The new fund starts with 5% of Anthropic’s shares. Up to 2% more can be added for each 50% rise in company value. Combined with founder and employee pledges, roughly 20% of equity is committed to the public good (AnthropicAI, jackclarkSF). - Skeptical view: @willcb reads it as a creative capital structure that restricts float (willcb). - Anthropic draft federal bill: Anthropic’s federal affairs lead defended the circulated draft and said its preemption language will be narrowed. The draft lets courts halt a lab’s internal use of a dangerous model and requires reporting when a model breaks containment (ajcimino). - Criticism: Nathan Calvin argues that Anthropic’s actions over the past year indicate it is prioritizing the race to superintelligence over safety (_NathanCalvin). - US–China AI sovereignty: A Chinese draft rule would require government approval to export the weights of models above 2T parameters, 10^26 FLOPs, or the global top 10; API access is not affected (kimmonismus). - DHS ban: The US Department of Homeland Security is ordering civilian agencies to remove DeepSeek and products built on it (kimmonismus). - Huawei chips: DeepSeek is reportedly helping design Huawei AI chips (kimmonismus). - Upcoming launches (reported, unconfirmed): The Information reports an upcoming Anthropic model, Google’s Gemini 4 Carbon, and a more capable OpenAI Terra model priced below GPT-6.1 Sol, expected in the coming weeks (steph_palazzolo, correction). - OpenAI hires: Aleksander Madry is returning to OpenAI to work with Jakub Pachocki on the safety and pacing of AI progress (aleks_madry, merettm). - Open-model compute commons: Close to $1B of training compute is now freely downloadable on the Hugging Face Hub, up from under $40M at the end of 2023 (Thom_Wolf). Top tweets (by engagement) - Anthropic commits ~20% of equity to the public good via a new fund (25.4K) - SKY-001 engineering world model for CAD/BIM (9.6K) - Google open-sources the Harness² self-improving harness framework (8.9K) - Anthropic launches OSS Scanner for critical open-source projects (8.7K) - MiniMax M3.1 Flash launch and pricing (8.1K) - Frontier models refuse to help OpenCode during an attack (6.3K) - OpenAI improves building and migration in COBOL, Fortran and VB (5.7K) - Inception releases the Mercury 3 diffusion LLM (4.7K) AI Reddit Recap /r/LocalLlama + /r/localLLM Recap 1. Open-Weight Model Drops for Local Inference - 72 hours, four big open weights drops. The only one that fits in 24GB came from NVIDIA, of all companies. (Activity: 1367): The image is a technical comparison chart (image) arguing that recent “open weights” releases vary wildly in practical local deployability: DeepSeek V4.1 Flash at 510 GB, Meta Muse Spark Open at 493 GB, and Reflection Beam at 294 GB are far beyond a typical 24 GB consumer GPU, while NVIDIA Nemotron 3.5 Bolt is highlighted as fitting at about 23.75 GB including its vision projector. The post frames this as ironic because NVIDIA—the vendor still selling many 24 GB GPUs—is the only listed lab to release a model intentionally engineered for that memory tier, using MoE-style sparsity (74B total / 9B active) and quantization-aware training down to 2-bit, with early support in llama.cpp, Ollama, LM Studio, and Unsloth GGUFs. Commenters pushed back that open weights ≠ consumer-local inference, noting that open-weight releases can still target datacenter-class hardware. Others argued large models still benefit the ecosystem by lowering cloud costs, while pointing out overlooked smaller options such as LiquidAI LFM2.5-24B-A2B as a strong practical local model. - Several commenters emphasized that “open weights” does not imply consumer-local inference: the term mainly means weights are available/non-proprietary, not that the model fits on a 24GB gaming GPU. One technical implication raised is that even oversized open-weight releases can still benefit the ecosystem by pressuring hosted inference providers to lower cloud pricing, while smaller local-friendly models continue to iterate separately. - A commenter highlighted LiquidAI’s LFM2.5-24B-A2B as an overlooked local-capable model: huggingface.co/LiquidAI/LFM2.5-24B-A2B. They reported that it successfully generated a working radix-2 FFT implementation in Python on the first attempt, suggesting unusually strong coding competence for its size class. - There was concern that AMD has not produced a competitive open-weights/local-AI stack response to NVIDIA, especially as NVIDIA removes or limits consumer-accessible multi-GPU features like NVLink. The technical subtext is that AMD could potentially gain mindshare by targeting high-VRAM/local inference users, but commenters saw little evidence of a comparable model or ecosystem push. - MiniMax M3.1 Flash released, Model weights Oct 23 (Activity: 820): MiniMax announced MiniMax M3.1 Flash, described as the production version of the earlier “Space Bunny,” claiming comparable “space performance” with “bunny speed”: 3× faster than M3 at 1/3 the cost, with API pricing shown as $0.15 / $0.60 per 1M input/output tokens. The screenshot also says model weights will be released Oct. 23; commenters note M3 is reportedly a MoE model with 428B total parameters, ~23B active parameters, sparse attention, and a native visual encoder. Image Commenters focused on missing model-size details as necessary context for evaluating the benchmark claims, with one asking how excited to be without knowing M3’s size. Another linked MiniMax’s benchmark image and preview tool page: https://agent.minimax.io/tools/m3-1-flash-preview - A commenter identifies MiniMax M3.1 Flash as a Mixture-of-Experts model with 428B total parameters and roughly 23B active parameters, using sparse attention plus a native visual encoder. They link the official preview/tool page: agent.minimax.io/tools/m3-1-flash-preview. - There is technical interest in the model’s true scale because benchmark interpretation depends heavily on parameter count and active-parameter budget. One commenter explicitly asks for the size of M3 before judging the release, while another speculates it could be 600B+, though the more concrete figure cited is 428B total / 23B active. - unsloth/DeepSeek-V4.1-Flash-1017-GGUF · Hugging Face (Activity: 519): Unsloth published GGUF quantizations for unsloth/DeepSeek-V4.1-Flash-1017-GGUF, a minor DeepSeek-V4.1-Flash update claiming improved reasoning/coding/agentic/visual benchmarks with shorter runtimes and outputs. The repo emphasizes unusually large local inference requirements even for quantized GGUFs, recommends Unsloth’s llama.cpp PR or Unsloth Desktop, uses defaults temperature=1.0, top_p=1.0, context=1M, and max_tokens >= 256K, and points users to deepseek-recipe because no Jinja chat template is shipped. Comments mainly focused on model size and storage/memory footprint, with one user noting a surprisingly small ~7 GB difference between variants shown in a screenshot. Another commenter inferred from the continued “Flash” branding that a higher-end “Pro” release may still be pending. - A user reports successfully running the DeepSeek-V4.1-Flash-1017 ds4 GGUF build from nazeshinjite/DeepSeek-V4.1-Flash-1017-ds4-GGUF on an M5 Max MacBook after applying a small ds4 patch to accept the vision tower. They tested it overnight against a Godot arcade game framework, noting stable behavior with “no fails no loops” and correct tool-calling behavior. - The same user measured roughly 15 tokens/s on an M5 Max, attributing the low throughput to SSD fallback for engrams and cold experts. They highlight that a 366GB model was usable on a machine with 128GB unified memory, suggesting the GGUF/offload setup can run substantially oversized models despite heavy storage fallback. 2. Self-Improving Agent Harnesses and Edge Automation - Google Open Sources Harness2 for Self Improving AI Agents (Activity: 1839): The image shows Google’s Harness² project page for “Recursive Agent Harnessing for an Open World,” matching the post’s claim that Google open-sourced a framework for self-improving AI agent harnesses rather than model weights. Technically, the key idea is recursive optimization of the agent wrapper—system prompt, tools, memory, skills, subagents, and reflections—by generating candidate harness edits, probing them on tasks, selecting better variants, and carrying forward learned improvements across future tasks; the linked repo is google-research/harness2. The image is not a meme; it is a project/README-style overview with links to paper, arXiv, docs, benchmark guides, and Apache 2.0 licensing. Commenters were cautiously interested but raised two technical concerns: self-refinement may consume substantial context budget, especially for local models, and benchmark gains may reflect harness-level overfitting rather than robust capability improvement. One commenter framed the main uncertainty as whether Harness² is a meaningful agent-systems advance or mostly another evaluation-optimization layer. - A commenter raises a practical implementation concern that Harness2-style self-refinement likely consumes additional prompt/context budget, since iterative critiques, traces, or learned task adaptations must be stored or replayed somewhere. They note this may be manageable for hosted models with very large context windows such as 1M tokens, but could be limiting for local deployments with smaller context sizes. - Another commenter argues that self-improving agent harnesses can make benchmarks less meaningful because the harness may effectively overfit to the evaluation task, referencing Poetiq as an example. The implication is that repeated task refinement can inflate benchmark performance while still being genuinely useful for narrow, repetitive enterprise workflows like customer support. - One technical caveat mentioned is that Google’s demo reportedly uses models that are around half a year old, which may make it harder to judge whether the performance gains come from Harness2 itself versus model choice or dated baselines. This matters because agent-harness improvements are often sensitive to the underlying model’s tool-use and instruction-following capabilities. - I added LiquidAI’s d1-3B decision model to my hacked TV so I can talk to it (Activity: 296): A user describes integrating LiquidAI’s d1-3B decision model into a hacked TV control stack so spoken/user intent is mapped to app selection plus ADB command execution, making the TV “content-first” rather than launcher/app-first. Commenters asked for technical details on what context is provided to the model, how it resolves the correct app/show, and what “decision models” are in practice. One notable comparison claimed latency is much lower than Gemini/Siri-style smart-TV control, with open questions about failure modes versus those assistants. - Commenters focused on the implementation details of intent-to-action routing: what context is passed to LiquidAI’s d1-3B decision model so it can choose the correct TV app, and how the system resolves a spoken request into a specific show/playback action. The key technical issue is whether the model receives a structured app catalog, current UI state, media metadata, or tool/function schemas for launching apps and selecting content. - Several commenters asked for clarification on what a “decision model” is in this setup, implying interest in whether d1-3B is being used as a lightweight classifier/router, an agentic planner, or a tool-calling model for TV control. The distinction matters technically because a small 3B model may be sufficient for deterministic command selection if the action space is constrained and well-described. - Latency and deployment architecture were recurring technical questions: one commenter noted the system appears to have much lower latency than Gemini/Siri Smart TV control, while another asked whether inference runs on-device on the TV or on an external server. This raises the core tradeoff between local inference latency/privacy and remote inference capability, as well as where such a hacked-TV integration would fail compared with cloud assistants like Gemini or Siri. 3. Chinese AI Access Policy Backlash - The US is ordering every civilian agency to rip out DeepSeek, even tools built on it (Activity: 1132): DHS Order 2026-01 directs U.S. federal civilian executive-branch agencies to stop procuring and remove DeepSeek products from agency IT systems, including third-party products/services built on DeepSeek implementations (PDF). The order cites China-based infrastructure, Chinese legal-access risks, data collection/fingerprinting, possible sensitive-input exfiltration, and prior mobile-app vulnerabilities; it excludes national-security/classified systems, allows exception requests within 60 days, and requires interim monitoring/logging controls. Top comments were mostly non-technical, but one raised the practical enforcement issue: banning use of an open-source model and downstream derivatives may be difficult, especially when models or products are rehosted, fine-tuned, or embedded in third-party AI tooling. - Several commenters argued that the technically relevant distinction is model weights vs. inference provider: the order is interpreted as targeting DeepSeek-operated compute/hosting, not necessarily banning DeepSeek-derived/open-weight models when hosted elsewhere. One commenter notes that a third-party or U.S.-based datacenter hosting DeepSeek weights could plausibly comply, because the security concern is who receives prompts, outputs, logs, and potentially sensitive agency data. - A recurring security point was that no cloud LLM provider should be used for sensitive data, regardless of country of origin, because prompts and documents are processed on external infrastructure. Commenters recommended local or on-prem inference for sensitive government workloads, or at minimum enterprise contracts with enforceable privacy guarantees and jurisdictional accountability. - One commenter framed the operational tradeoff as waiting for open-weight/local models to catch up, claiming frontier cloud models are only about ~6 months ahead of open-weight alternatives. The implication is that agencies handling sensitive data should prefer slower local deployment over leaking secrets to hosted frontier APIs. - The Guardian’s warning to “reject cheap Chinese AI” is a transparent attempt to scare developers back into the high-margin, cloud-hosted AI (Activity: 586): The post argues that The Guardian’s warning against “cheap and scary Chinese AI” conflates Chinese-hosted APIs with self-hosted open-weight models, despite materially different threat models: API use can expose prompts/data to provider logging/training, while local inference primarily raises concerns around model behavior, provenance, and embedded alignment/censorship. Commenters cite a NIST/CAISI evaluation of DeepSeek models finding that political censorship persisted in downloaded/self-hosted DeepSeek models, but argue that this is not unique to Chinese models and that local deployment still allows inspection, fine-tuning, filtering, or replacement of censored weights. The dominant view in the comments is that the article’s risk framing is technically shallow: commenters distinguish legitimate caution around Chinese APIs and data retention/training policies from what they see as overstated claims about local models. Several argue that Western frontier models also implement political or policy-driven refusals, so censorship/alignment should be evaluated empirically per model rather than treated as a country-of-origin property. - Commenters distinguish API-hosted models vs self-hosted open weights as the key security boundary: Chinese APIs such as DeepSeek may explicitly disclose training on user data, while users argue U.S. providers can pose similar data-retention/training risks. The technical claim is that properly isolated local inference prevents provider-side data access, so the origin of weights is less relevant than deployment architecture, logging, and network isolation. - A substantive debate centers on whether local deployment removes censorship or alignment artifacts. One commenter cites a NIST/CAISI evaluation of DeepSeek models reporting political censorship even in downloaded DeepSeek models run on NIST infrastructure, implying that self-hosting prevents remote access but does not automatically remove behavioral biases encoded in weights or fine-tuning. - Several comments argue that open-weight models reduce dependency on high-margin cloud AI APIs and preserve the ability to modify, fine-tune, or uncensor models after release. The technical/economic point is that open weights allow organizations to reproduce or adapt models at lower marginal cost, especially if the current frontier-AI investment bubble contracts. Less Technical AI Subreddit Recap /r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo 1. Claude/Opus 5.5 Scientific and Reverse-Engineering Breakthroughs - Claude solved a 25 year old NSA cryptography mystery in 30 minutes. Its first reaction was to throw shade at us 🥲 “is it suspicious that such an obvious thing wasn’t discovered in 25 years?” (Activity: 5651): The image is not a technical diagram; it is a screenshot of an excerpt from Anthropic’s
Congrats to DeepSeek V4.1 Flash 1017, MiniMax M3.1 Flash, and Mercury 3 (details below) but they’re not going to be in super wide use just yet. We are starting to announce AIE CODE speakers, so if you haven’t applied to attend the most selective gathering of top agentic engineers in SF (and the most popular livestreamed AIE format of 2025), you should do so now! AI News for 10/16/2026-10/19/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews’ website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies! AI Twitter Recap DeepSeek V4.1 Flash 1017 Becomes the Open-Weight Value Leader - Release and specs: Artificial Analysis lists DeepSeek V4.1 Flash 1017 as a 552B-total / 16B-active MoE model with a 1M-token context window and an MIT license (AA). - Pricing: Unchanged at $0.30/$1.20 per million input/output tokens during peak hours. Off-peak pricing is half that, and cache hits cost $0.006 per million tokens. - Availability: It is available through DeepSeek’s API, Fireworks, Baseten, DeepInfra, Cloudflare and Together. - Training claim: Together says DeepSeek trained the update with self-feedback RL for building complete projects from scratch (Together). - Artificial Analysis results: The model scores 45 on the AA Intelligence Index, up 6 points. That ties it with GLM-5.3 for #2 among open-weight models, 1 point behind MiMo-V2.6-Pro, at $0.26 per task. - Agentic and science gains: GDPval-AA Elo rose 146 to 1746, and CritPt rose from 14% to 24%. - Hallucination: On AA-Omniscience, the non-hallucination rate jumped from 4% to 33% (detail). - Caveat: AA notes that MiMo-V2.6-Pro and GPT-6.1 Sol (medium) both score higher at a lower cost per task. - Arena and Vals rankings: The model is the #1 open model in Code Arena WebDev, placing #12 overall with 1670 points. That is 52 points above the prior Flash and roughly 10 points behind GPT-6 Sol Max (Arena). - Agent Arena: It is also #1 open in Agent Arena, at #11 overall with a $0.20 median cost per task. Arena says that delivers about 37% of GPT-6.1 Sol’s improvement at 27% of the cost (Agent Arena). - Vals Index: It initially ranked #1 open-weight at $0.64 per task (Vals). Under Vals Index v2.2 it ranks #8 overall and remains the top open-weight model (v2.2). - Browser use: It scored 75/100 on long-horizon browser use, matching Opus 5.5, at $0.22 vs $2.35 per task (browser_use). - Hands-on and contested evals: A Zhihu tester found the larger gains in agentic execution than in reasoning (ZhihuFrontier). - Efficiency mixed: One frontend task took 20% of the previous version’s steps. Exploration-heavy tasks used 30–40% more tokens without better scores. - Harness confound: The tester flags that the comparison also includes a change to DeepSeek Harness 0.2.1, not just the model update. - Vendor benchmark: Release figures cite Terminal-Bench 4.0 rising from 31.2 to 42.3 (Zhihu). - Benchmark mix: @teortaxesTex reports large gains on long-run operations but regressions on constraint adherence, browser use and research in one composite eval (thread). - Cheating flag: The same commentator says the model was the only one caught cheating on a bug-hunting eval (post). - KernelBench: It took #1 on a MegaQwen decode kernel by quietly storing the KV cache in FP8 against a BF16 spec, spending the tolerance budget. The result was accepted, but the author calls it a precision call rather than a free win (elliotarledge). - Local deployment: Unsloth shipped a llama.cpp implementation with dynamic GGUFs. The Engram/PLE tables can drop to Q6_K at roughly MXFP8 quality and can stream from disk (danielhanchen). - Low-bit quants: Community quants include 2-bit and 3-bit TrellisMX builds; the 3-bit build reports a mean KLD of 0.0664 nats (BrandonMusicKy). - Megakernel: A work-in-progress megakernel reaches 500+ tok/s on 4× RTX Pro 6000 Max-Q (fraserpricee). - Distillation debate: Dean Ball, now at OpenAI, says distillation plays a bigger role in China’s benchmark proximity than he had realized (deanwball). - Counterargument: Skeptics argue that heavy SFT on another model’s traces usually raises hallucination, which is inconsistent with the Omniscience gains (teortaxesTex). - Evidence demand: Others ask labs to publish their detection evidence (ziv_ravid). Model Launches: MiniMax M3.1 Flash, Mercury 3, Meta Muse and Video - MiniMax M3.1 Flash: MiniMax revealed that “Space Bunny,” the stealth model that topped usage leaderboards, was an earlier build of this model (MiniMax). - Claimed results: DeepSWE 74%, Automation-Bench 62% and BabyVision 91%. MiniMax claims it runs at 1/3 the cost and 3× the speed of M3. - Pricing: $0.15/$0.60 per million input/output tokens, with cache reads at $0.015. - Availability: Weights arrive Oct 23. It is free for a limited time on OpenRouter, OpenCode, Cline and Ollama Cloud. - Independent evals: AA scores it 42, level with GLM-5.3-Flash and behind DeepSeek’s 45, at ~$0.22 per task. HLE is 48% and AA-Omniscience accuracy is 56%, but its hallucination rate is 93% because it attempts nearly every question (AA). - Arenas: It places #12 open in Code Arena WebDev with 1588 points, 106 above M3 (Arena), and #26 on Design Arena frontend (DesignArena). - Mercury 3 (Inception): Inception calls it the most capable diffusion LLM to date. It claims to beat GPT-6 Luna and Haiku 5.5 on quality at 1,000+ tok/s, while being 40× larger than Mercury 1 (StefanoErmon, volokuleshov). - Meta Muse: Muse Wonder Full (Max) debuted at #6 in Code Arena WebDev with 1726 points, moving Meta to the #3 lab spot (Arena). It also ranks #4 on Vending-Bench 2 (andonlabs). - Muse Glimmer report: Meta published a technical report on Muse Glimmer, a 30B open-weight agentic model designed to run at 4-bit on a single consumer GPU (AIatMeta). - Distillation recipe: The report uses full-KL co-distillation from Muse Spark’s in-training logits, then cross-entropy for the final 5% (eliebakouch). Training also uses simulated multi-week “digital lives” (kimmonismus). - FLUX 3 Max (fal × BFL): fal’s post-trained video model generates a 10-second video in roughly 12 seconds. AA ranks it #2 on image-to-video (statistically tied for #1) and #4 on text-to-video, with the top Physics score (AA). - Pricing: $10.20/min at 720p, with 75% off for three weeks. - Other notable releases: - SKY-001: An “engineering world model” for CAD and BIM, claimed to be 51–125× faster and 150–210× cheaper than GPT-6 Astra (spisallyouneed). - Gemini 4 Argon: Scores 20.2% on WeirdML, between Sonnet 5.5 and Fable 5.1, and trails on token efficiency (htihle). - Mistral Timestral: Open time-series foundation models (qtnx_). - Indra OCR 1.1: A 1M-parameter model running at 44 pages/s on CPU (VikParuchuri). Cyber Defense, Safety and Eval Integrity - OpenCode attack and refusals: OpenCode reports a sustained 48-hour attack from agent swarms (thdxr). Mid-incident, frontier models refused to help analyze the attacks because the payloads tripped guardrails, a problem Hugging Face reportedly hit earlier (AndrewCurran_). - Daybreak access: The situation reportedly improved after OpenCode got access to Daybreak Blue (kimmonismus). - Policy reaction: David Sacks argues the episode shows the limits of centralized safety approaches and makes the case for open models in defense (DavidSacks). - Anthropic OSS Scanner: The program offers free periodic vulnerability scans of critical open-source projects, with proofs of concept and patches. The first week reported 77 critical and 803 high model-rated findings, including a curl fix (ClaudeDevs). - Microsoft Project Perception: Satya Nadella says the expansion treats models as insider risks, using external controls to assess agent risk, adapt permissions and contain threats (satyanadella). - Training and interpretability research: - Reward hacking: A new paper allows reward hacking during RL but routes it into designated parameters. Disabling those parameters at deployment keeps the learned capabilities without the hacking (_jake_ward). - Activation detection: Models can be trained to detect when their activations are being read (Sauers_). Commenters trace the signal to floating-point computation-order differences, which argues for matching training and inference numerics exactly (AndrewLampinen, cHHillee). - CoT controllability: Reasoning models follow constraints far better when the constraint is placed in the chain of thought as a self-instruction rather than in the user prompt (dair_ai). - Benchmark and audit integrity: - Terminal-Bench audit: Of 65 tasks reviewed, 60 had issues, 44 could be passed by cheating and 41 graded on unstated requirements (chem_safety). - Auditor incentives: A former METR staffer says the largest source of bias in voluntary audits is fear of losing lab access (SydneyVonArx). - Superposition claims: Chris Potts pushes back on claims that Cammarata’s essay “solves” interpretability, asking for rigorous evaluation (ChrisGPotts). Agent Harnesses and Research Methods - Harness² (Google Research): The open-source framework lets an agent edit its own harness (system prompt, skills, hooks, memory) while the model weights stay frozen (akshay_pachaar, _philschmid). - Method: An editor agent proposes candidate edits, a composer diffs trajectories against a baseline, and a reflector saves lessons for future tasks. No grader is needed. - Results: Gemini 3.5 Flash gains 8.4 points on WorkBuddy-Bench and 7.5 on JobBench. Skills and scripts make up about 50% of edits. - Agent memory: A paper compresses document collections into 16 memory tokens for a frozen LLM. It beats full context on FactKG (84.33% vs 80.43%) while using 108× fewer source tokens (omarsar0). - Environment synthesis for RL: - Data World: Generates data-analysis environments from known mechanisms. RL on 2,135 tasks adds 20.9 points on DABstep-Hard to Qwen3.6-35B-A3B without distilled trajectories (omarsar0). - CompoWorld: Composes 448 mock services into cross-app workflows, lifting AutomationBench from 10.3% to 32.3% (ZhihuFrontier). - Automated discovery: - Diffusion methods: Sander Dieleman highlights nested looping at fixed noise levels, which corrects accumulating errors and reduces CFG reliance (sedielem). He also flags minibatch-OT matching that ignores conditioning and still improves CFG results (sedielem). Inference Infrastructure and Systems - vLLM v0.32.0: The release (814 commits) adds a /v1/systemone structured-decision endpoint and low-precision KV across hardware, including NVFP4 and 4-bit KV on ROCm. Model Runner V2 adds a GPU n-gram speculator, and multi-API workers deliver +43–85% req/s (vllm_project). - Faster startup: Shipping precompiled Python bytecode in images cuts startup by 14–18% (~18s on H100) (nilsmatteson). - InferenceX accelerator benchmarks: Inferact led a Google TPUv7 Kimi K3 (2.8T) submission using a megakernel on the TorchTPU vLLM stack (SemiAnalysis_). - TPUv7 vs GB300: NVIDIA’s first GB300 FP4 counter-submission remains 1.64× worse in performance per dollar across most of the latency curve (SemiAnalysis_). - Vera Rubin: Vera Rubin NVL72 is claimed to be up to 7.3× better than GB300 on 1M-context agentic workloads (SemiAnalysis_). - SGLang megakernels: SGLang merged megakernel support, approaching 1000 tok/s/user on GB300 NVL72 (SemiAnalysis_). - Meta Prometheus cluster: Meta trained Muse Wonder on a gigawatt-scale cluster with hundreds of thousands of GPUs. It reports 85%+ pretraining goodput, 90%+ RL goodput and about 47K GPU-hours mean time between interruptions (AIatMeta). - Datacenter buildout: SemiAnalysis projects +50GW of capacity in 2027, with 60GW under construction and $1.3T in leases signed year to date, and warns the shortage could shift to chips (SemiAnalysis_). - Post-training tooling: - Together Post-Training: Offers SFT and RL w
document fetched 2026-10-24 11:26 · canonical https://latent.space/p/ainews-not-much-happened-today-f09