Skip to main content
Back

OpenAI GPT-5.2-Codex: 56% accuracy on SWE-Bench Pro coding tasks

On Google's On-Device Gemma, Meta's Audio Encoder, Claude in Chrome, Mistral's OCR-3, ChatGPT Pinned Chats.

December 19, 2025 3 min read

Hey,

Your daily briefing is ready. You can finally take a break from the AI firehose.

Our algos spent the night splitting signal from noise and pulled the top news, models, papers, and repos.

Here’s the must-read:

Summary

Read time: 3 min 45 sec

Top News

▸ OpenAI ships Codex update focused on reliable context for long coding sessions

Tiny Fish

▸ Replace expensive browser agents with scalable web automation using Mino

Top News

▸ Google introduces a compact model for strict on-device API execution

Top Paper

▸ Meta open-sources PE-AV, the engine behind SAM Audio’s separation quality

Signals

▸ Anthropic adds Claude Code support as Chrome extension reaches all plans
▸ Mistral releases OCR 3: beats enterprise OCR at 97% on real-world documents
▸ Anthropic makes Agent Skills an open standard for extensible agents
▸ OpenAI rolls out pinned chats in ChatGPT for faster access to conversations
▸ Google launches video authenticity checks in the Gemini mobile app.
Author photo
Today's Author
Lior Alexander. Founder of AlphaSignal and former ML Engineer. Previously built ML systems at Iguazio, Guesty, Enphase, Mila.
Top News
OpenAI introduces GPT-5.2-Codex to retain task state across extended coding and terminal sessions
11,342 Likes
Grok 4 Fast Benchmark

GPT-5.2-Codex introduces a focused update to OpenAI’s agentic coding stack, aimed at real software engineering rather than single-shot code generation.

Large repositories, failed attempts, and long terminal sessions expose a consistent weakness in earlier models.

GPT-5.2-Codex addresses this by optimizing GPT-5.2 for long-horizon work inside Codex, with native context compaction as the key technical change.

Context compaction means the model compresses prior steps while preserving intent, state, and decisions. This lets you run extended workflows without losing track of plans or exceeding context limits.

The result is a model that sustains reasoning across refactors, migrations, and iterative debugging.

It fits engineers who already rely on Codex for real development rather than short snippets.

Key features

  • Native context compaction preserves task state across long, multi-step sessions

  • Stronger agentic behavior for refactors, migrations, and multi-file changes

  • More reliable tool calling and terminal control over extended workflows

  • Improved native Windows terminal support

  • Vision input for screenshots, diagrams, and design mocks

Results and benchmarks

  • SWE-Bench Pro accuracy: 56.4%, above GPT-5.2 at 55.6%

  • Terminal-Bench 2.0 accuracy: 64.0%, above GPT-5.2 at 62.2%

Test refactors
Presented by Tiny Fish
What would you build if any website could be an API?
alpha_signal_image_1

An app that finds urgent care availability in real time. A service that monitors government RFP portals for new contracts. A tool that pulls live menu prices from local restaurants.

Most of the web isn’t covered by APIs. The useful parts live behind forms, logins, and dynamic interfaces built for humans, not code. Mino is a web agent API that gives you programmatic access to that missing 95%.

You send natural language instructions. Mino runs the work across websites and returns structured results.

Unlike general-purpose browser agents like Claude Computer Use, Gemini 2.5 Flash, ChatGPT Atlas, Mino runs multiple jobs in parallel and is designed for scale.

It’s faster, cheaper, and more reliable for production workloads that depend on live web data.

Start building now
partner with us
Top News
Google releases FunctionGemma, a 270M on-device model that boosts function-calling accuracy from 58% to 85%
3,932 Likes
Grok 4 Fast Benchmark

oogle ships FunctionGemma after months of feedback from developers who want models that act, not just reply.

Edge agents exist, but prompt-based function calling often breaks, emits invalid JSON, or fails offline. Google addresses this gap with a 270M Gemma 3 variant that encodes function calling directly into the model weights.

The key result stands out: accuracy rises from 58% to 85% on the Mobile Actions benchmark after fine-tuning.

FunctionGemma treats “function calling” as structured API execution, not text tricks. A function equals a predefined action with a name and typed arguments, expressed as strict JSON.

The model learns to output that structure reliably. This design matters on-device, where latency, memory, and privacy block cloud calls.

You use FunctionGemma when you own a fixed API surface and need deterministic behavior. You fine-tune it on instruction–action pairs, then deploy it locally or place it in front of larger models.

Key features and results

  • Encodes function calling in weights, not prompts or post-processing

  • Improves Mobile Actions accuracy from 58% to 85% after fine-tuning

  • Runs at 270M parameters on phones and Jetson Nano-class devices

  • Uses a 256k vocabulary to shorten JSON and multilingual sequences

  • Available on Hugging Face and Kaggle for download and fine-tuning 

Download it now
Top Paper
Meta publishes PE-AV as open-source, foundational model supporting SAM Audio’s audio separation
1,129 Likes
Grok 4 Fast Benchmark

Meta open-sources Perception Encoder Audiovisual (PE-AV), the multimodal encoder that powers SAM Audio.

Audio, video, and text models usually live apart, which forces teams to stitch systems together. PE-AV starts from a simple idea: learn one shared representation that understands all three at once.

Meta builds PE-AV on its earlier Perception Encoder and extends it to audio. The model trains with contrastive learning, which pulls matching audio, video, and text closer in embedding space while pushing mismatches apart.

Meta scales this setup across ten modality and caption pairings and trains on ~100M audio-video pairs with synthetic captions covering speech, music, and sound effects.

This design produces a single encoder that works across tasks without task-specific heads.

Key features

  • Unified audio-video-text embeddings from one encoder

  • Ten contrastive objectives across modality and caption pairs

  • Synthetic captions at scale across multiple audio domains

Test the code
Signals
1 Anthropic expands Claude in Chrome to all paid tiers and adds full Claude Code integration 5,128 Likes
2 Mistral introduces OCR 3, a faster, cheaper, higher-fidelity model for broad enterprise document pipelines 2,081 Likes
3 Anthropic open-sources Agent Skills as a universal standard for sharing capabilities across agent systems 2,374 Likes
4 OpenAI presents pinned chats, enabling quick access to important conversations on all platforms 2,984 Likes
5 Google adds SynthID-powered video verification to Gemini, detecting AI-generated audio and visuals 1,268 Likes
At Alpha Signal, our mission is to build a sharp, engaged community focused on AI, machine learning, and cutting-edge language models, helping over 200,000 developers stay informed and ahead. We’re passionate about curating the best in AI, from top research and trending technical blogs to expert insights and tailored job opportunities. We keep you connected to the breakthroughs and discussions that matter, so you can stay in the loop without endless searching. We also work closely with partners who value the future of AI, including employers and advertisers who want to reach an audience as passionate about AI as we are.

Our partnerships are based on shared values of ethics, responsibility, and a commitment to building a better world through technology.Privacy is a priority at Alpha Signal. Our Privacy Policy clearly explains how we collect, store, and use your personal and non-personal information. By using our website, you accept these terms, which you can review on our website. This policy applies across all Alpha Signal pages, outlining your rights and how to contact us if you want to adjust the use of your information. We’re based in the United States. By using our site, you agree to be governed by U.S. laws.
Looking to promote your company, product, service, or event to 250,000+ AI developers?
Work with us