Nvidia Shows How to Cut AI Context Without Sacrificing Accuracy
Nvidia research shows compacting AI agent context to 16,000 tokens boosts throughput up to 7x on Qwen 3 Coder Next while preserving SWE-bench accuracy
20 stories
Nvidia research shows compacting AI agent context to 16,000 tokens boosts throughput up to 7x on Qwen 3 Coder Next while preserving SWE-bench accuracy
How post-training and action verification shape AI agent performance.
Latent Sparse Attention (LSA) from Prefrontal AI and ETH Zurich clusters keys to speed long-context LLM inference, cutting 10M-token time to first token by over 9 times
Google's EnvHarness adapts existing agent training environments based on failure patterns, boosting ALFWorld held-out task success by nine percentage points
Timestral's largest model has 209 million parameters and leads three pretrained, zero-shot forecasting benchmarks. The smallest forecasts 96 steps from 2,048 observations in 17 milliseconds on eight CPU threads.
Mem0 leads on GPT-4o-mini. Pi with Claude Opus 5.5 scores 99% for $6.95, against 95% at $17.84 for full context
Prompt filters and borrowed human tokens don't hold up once agents reach production. Ory Agent Security splits the problem in two: authorize every tool call inside the agent loop, and give every deployed runtime its own machine identity.
Rough concept first, then the words. 10x to 31x faster than strong diffusion models, on 4x to 5x fewer training tokens
Your agent harness is an architectural decision that directly dictates task success and API costs. Here is how to match it to your workload.
How prompt injection exploits trust boundaries through saved memory, and what runtime checks can prevent unsafe actions.
Nvidia's Qwen3 14B to 32B mapper is 25.1x vs re-prefill at 32,768 tokens. Cache-to-Cache reports about 2.5x against text
Classify depth, time, or flow. Nanbeige is the downloadable LLM. RLT lost at 140M. Looped Flows is a 5-7M puzzle net
Self-Harness reports relative gains of up to 132%. EnvHarness adds up to 9.0 points and 9.8% fewer steps
Why agent instructions accumulate and how to decide what to keep, move, or remove.
TypeSafe's Jev returns a typed answer in 70 to 500 ms at $0.042 per million input tokens, with no metered output-token cost
METR’s API key theft shows why you must check authentication, credential access, and permissions before deployment.
21 combos, 60 tasks, 5x cost swing, and a 4-tool harness on the Pareto frontier
A 552B model with 890-byte KV cache, 8B active on input, and an Artificial Analysis 40 versus Gemini 3.8 Flash High at 41
Mark each agent job Promote, Hybrid, or Reject. RST is allowed only when the job is hermetic, bounded, reproducible, and outcome-verifiable
Fine-tuned 0.8B Qwen beat GPT-5.6 Sol xhigh, 2 million buyer profiles a day became 72 million, and GraphQL serving fell from $27 million to $1 million