Microsoft
2025-11-05 00:01 · Jilin Even Ultraman Is Worried --- Source Large Model Intelligence｜Sharing Source: Quantum Bit --- A Surplus of GPUs… Gathering Dust Imagine this — Microsoft owns mountains of GPUs, yet many are sitting unused in storage. In the latest BG2 podcast episode, Microsoft CEO Satya Nadella openly admitted
AI infrastructure
Altimeter Conversation: Microsoft & OpenAI’s $3 Trillion AI Infrastructure Vision Date: Shanghai, 2025‑11‑01 10:20 Event: Brad Gerstner (Altimeter Capital) hosts Satya Nadella (Microsoft) and Sam Altman (OpenAI) for a rare, investor‑focused deep dive on AI. --- Introduction At the center of global technology, Microsoft and
PyTorch
PyTorch Conference 2025 — Advancing Open & Scalable AI Infrastructure At the 2025 PyTorch Conference, the PyTorch Foundation announced several major initiatives to advance open, scalable AI infrastructure. Key highlights included: * Ray joining as a hosted project * Introduction of PyTorch Monarch for simplified multi-machine AI workloads * Showcasing open research efforts such
AI model
Introducing SWE‑1.5: A New Fast Agent Model Read the full announcement (via) --- Overview On the same day that Cursor released Composer‑1, Windsurf announced SWE‑1.5 — its latest frontier-size coding model boasting: * Hundreds of billions of parameters * Near state-of-the-art (SOTA) coding performance * Extreme speed: up to
Google Cloud
Today's AI Models: From Billions to Trillions of Parameters AI systems are rapidly expanding from billions to trillions of parameters, evolving into highly capable, multi‑modal reasoning engines. This complexity demands a new class of infrastructure and software to handle unprecedented computational and memory requirements. At Google Cloud,
AI infrastructure
# AI-Native Application Infrastructure: From Cloud-Native Foundations to Intelligent Agent Ecosystems Over the past decade, we have built the **cornerstone of Application Infrastructure** in the cloud-native era — middleware, databases, containers — and, through **message queues**, **real-time computing**, and **distributed storage**, we have constructed the high-speed highways of modern **Data Infrastructure**. Now the
AI infrastructure
# Introduction IDC recently released a report titled *"AI-Native Cloud / New Cloud Vendors Restructuring Agentic Infrastructure"*. Key survey highlights include: - **87% of Asia-Pacific enterprises** had deployed at least 10 GenAI scenarios by 2024 — expected to rise to **94% by 2025**. - **Daily GenAI usage among consumers** increased from
Databricks
# Building a Lightning-Fast Inference Runtime for Real-World AI Workloads Building an ultra-efficient inference runtime is not just about **raw speed** — it's about solving **high-impact problems** for real customers. At **Databricks**, our **Data Intelligence** strategy centers on helping customers transform proprietary data into AI agents capable of serving production
AI infrastructure
AI Is Reshaping Every Facet of Life Artificial Intelligence is transforming health, software engineering, education, productivity, creativity, and entertainment at an unprecedented pace. Recent Google breakthroughs include: * Magic Cue on Pixel 10 — delivering more personal, proactive, and context‑aware assistance. * Viral Nano Banana Gemini 2.5 Flash image generation. * Code
GPU utilization
Why Your GPU Is Probably Idle — And How HAMi Fixes That Most of the time, your GPU’s computing power is idle, with utilization often dropping below 20%. --- Expensive GPUs, Low Usage Let’s look at a few tempting — and wallet-draining — models: NVIDIA A100 80GB, H800 80GB, RTX 4090
LLM inference
# Disaggregated LLM Inference: Breaking the Bottlenecks in AI Infrastructure Artificial intelligence models are evolving **at an accelerating pace**, yet infrastructure has lagged behind. As large language models (LLMs) grow from simple chatbot tools to enterprise-scale solutions, **traditional monolithic server architectures are becoming a major bottleneck**. **Disaggregation**—splitting different stages of