Skip to main content
Back

OpenAI Launches Stargate: $500B AGI Infrastructure Project

READ MORE

January 22, 2025 5 min read

Hey,

Welcome to AlphaSignal – the most read newsletter by AI developers. 


We bring you the top 1% of news, papers, models, and repos, all summarized to keep you updated on the latest in AI.

IN TODAY'S SIGNAL

Read time: 5 min 45 sec

🎖️ Top News

📌 Oxylabs

⚡️ Trending Signals


📌 Lambda

💻 Top Models

  • MiniCPM-o 2.6 handles vision, speech, and multimodal tasks with advanced ASR capabilities.

  • Flex.1 alpha generates images from text using an 8B-parameter rectified flow transformer.

  • ReaderLM v2 processes HTML into Markdown/JSON, excelling at structured data extraction and formatting.

🧠 Python Tip

  • Custom autograd functions optimize memory, computation, and gradient calculations for efficient models.

If you're enjoying AlphaSignal please forward this email to a colleague. 

It helps us keep this content free.

TOP NEWS

AI Infrastructure

OpenAI announces Startgate, a $500B project for scaling AGI with NVIDIA, Oracle, and Azure

⇧ 67,385 Likes

What's New

OpenAI announces the Stargate Project, a $500 billion effort to create advanced AI infrastructure. The project begins with an immediate $100 billion deployment for data centers, starting in Texas. It supports OpenAI’s goal of scaling artificial general intelligence (AGI) and training advanced AI models.


Key Technical Details

  • NVIDIA GPUs power compute-intensive workloads.

  • Oracle provides high-capacity cloud infrastructure.

  • Microsoft Azure supports scalable distributed AI model training.

  • Aims to develop AGI and expand OpenAI's model capabilities.

  • Focus on high-value fields like personalized medicine and biotechnology.

  • Build infrastructure to support AGI and next-generation model development.

Technical Scope

The project focuses on high-performance AI infrastructure capable of training and deploying advanced AI models. NVIDIA provides AI accelerators and GPUs for parallel processing, optimized for large-scale model training. Oracle brings expertise in cloud scalability to handle data-intensive workflows.

Comparison and Competition

While the Stargate Project sets a new scale in private AI investment, open-source efforts like China’s DeepSeek R-1 present leaner alternatives. Released under the MIT License, DeepSeek R-1 matches OpenAI’s o1 models on reasoning benchmarks, highlighting global competition in AI development.


Unprecedented Scale of Investment

The $500 billion budget represents the largest private AI infrastructure investment to date. Training OpenAI’s GPT-4 required more than 10,000 GPUs operating for months. Stargate’s infrastructure will scale far beyond this capacity, enabling faster development and training of advanced AI models.


Target Applications

Oracle highlights healthcare as a primary use case for the new infrastructure. The system aims to accelerate research into personalized mRNA vaccines and cancer treatments by supporting large-scale AI-driven biomedical analysis.

Read more

Oxylabs has launched free Datacenter Proxies

For the first time ever, Oxylabs, a renowned leader in the proxy industry, is offering five free datacenter IPs. This is a significant milestone, as Oxylabs has always been synonymous with reliability and high success rates - qualities often lacking in free proxy services.

This is a rare opportunity for users to explore the performance and dependability of premium datacenter IPs without any cost. Whether you're engaging in data collection, market analysis, or simply building your project, you can start with Free Oxylabs Proxies and scale as you go. No credit card is required.

Oxylabs’ decision to open up free access marks a new chapter in the proxy market, emphasizing innovation and inclusivity. It's an exciting development for anyone seeking reliable solutions without compromise.

GET FREE IPs

partner with us →

TRENDING SIGNALS

AI Search API

Perplexity launches Sonar API for real-time search with citations with 2x context, outperforms GPT-4o and Claude in factuality

⇧ 3,037 Likes

LLM

Google updates Gemini 2.0 Flash with configurable thinking for advanced AI tasks; excels in math, science, and reasoning

⇧ 1,536 Likes

Conversational AI for Support

ElevenLabs integrates Conversational AI in docs, handling 80% of user inquiries daily, improving user support efficiency

⇧ 548 Likes

Generative AI

Netflix releases an open-source text-to-video generation model that enables control over motion patterns of video diffusion models

⇧ 2,036 Likes

AI Agent

ByteDance presents an open-source GUI agent with reasoning and precise UI task execution, achieving 82.8% on VisualWebBench

⇧ 1,689 Likes

Test Your Workloads on Highest-Performing NVIDIA GPUs

NVIDIA GH200 Grace Hopper Superchips (ARM64 + H100) are now available on Lambda at $1.49 per GPU per hr.


Evaluate your tools, workflows, and libraries on ARM64 CPU architectures and prepare for the upcoming Blackwell GB200 series.

Access GH200 instances immediately and ensure compatibility with future systems.

Spin up an instance ↗️

TOP MODELS

Multimodal Model

MiniCPM-o 2.6

⇧39,162 Downloads

This model helps you handle vision, speech, and multimodal live streaming efficiently. It uses 8B parameters and achieves a 70.2 score on OpenCompass, surpassing GPT-4V and Claude 3.5 Sonnet in image, video, and multilingual capabilities. It supports real-time speech interaction with state-of-the-art ASR and live streaming performance.

Text-to-Image

Flex.1 alpha

⇧ 5,616 Downloads

Flex.1 alpha is a model with 8 billion parameters that generates images from text. It’s based on the FLUX.1 architecture but with fewer layers (8 instead of 19). It uses a guidance system to create images without needing extra adjustments (CFG). It can be fine-tuned, works under Apache 2.0 license, and handles 512 tokens of input.

Text Generation

ReaderLM-v2

⇧ 14,065 Downloads

ReaderLM v2 processes raw HTML into Markdown or JSON with a 1.5B parameter model. It supports up to 512K tokens and 29 languages. Compared to its predecessor, it handles longer contexts better, reduces degeneration, and excels at preserving document structure. It excels at nested structures, LaTeX, and complex formatting. It outperforms larger models like GPT-4o-2024 in structured data extraction, maintaining low degeneration via contrastive loss.

PYTORCH TIP

Efficient Feature Engineering with Pandas apply and NumPy Vectorization

Custom autograd functions in PyTorch allow you to optimize memory and computation by defining your own forward and backward passes. This can be particularly useful for implementing novel operations or improving the efficiency of existing ones in custom neural network layers.


Instead of relying on standard layer implementations, creating custom autograd functions gives you the flexibility to optimize memory usage and compute during both forward and backward passes.


Why This Works

By defining custom behavior for the forward and backward passes, you can optimize gradient calculations or incorporate non-standard operations, leading to reduced memory overhead and improved performance.


When to Use
Use this approach when you need custom layer behaviors or optimizations that PyTorch does not provide by default, particularly when managing memory-intensive models.

Example


import torch

class ScaledTanh(torch.autograd.Function):
    @staticmethod
    def forward(ctx, input, scale):
        ctx.save_for_backward(input, scale)
        return torch.tanh(input) * scale

    @staticmethod
    def backward(ctx, grad_output):
        input, scale = ctx.saved_tensors
        grad_input = grad_output * scale * (1 - torch.tanh(input) ** 2)
        grad_scale = (grad_output * torch.tanh(input)).sum()
        return grad_input, grad_scale

input_data = torch.randn(3, requires_grad=True)
scale = torch.tensor(2.0, requires_grad=True)

output = ScaledTanh.apply(input_data, scale)
output.sum().backward()

At Alpha Signal, our mission is to build a sharp, engaged community focused on AI, machine learning, and cutting-edge language models, helping over 200,000 developers stay informed and ahead. We’re passionate about curating the best in AI, from top research and trending technical blogs to expert insights and tailored job opportunities. We keep you connected to the breakthroughs and discussions that matter, so you can stay in the loop without endless searching. We also work closely with partners who value the future of AI, including employers and advertisers who want to reach an audience as passionate about AI as we are.


Our partnerships are based on shared values of ethics, responsibility, and a commitment to building a better world through technology.Privacy is a priority at Alpha Signal. Our Privacy Policy clearly explains how we collect, store, and use your personal and non-personal information. By using our website, you accept these terms, which you can review on our website. This policy applies across all Alpha Signal pages, outlining your rights and how to contact us if you want to adjust the use of your information. We’re based in the United States. By using our site, you agree to be governed by U.S. laws.

Looking to promote your company, product, service, or event to 200,000+ AI developers? Let's work together.

Work with us