← Back to blog
AI Companies·October 25, 2026·11 min read

DeepSeek, Profiled: How a Quant Hedge Fund's AI Lab Rewrote the Scaling Debate

DeepSeek's R1 release wiped roughly $589 billion off Nvidia's market cap in a single trading day by suggesting frontier-level reasoning didn't require frontier-level spend — here's what the company actually built, what its cost claims do and don't mean, and why its chip workarounds matter more than its benchmark scores.

On January 27, 2025, Nvidia's stock dropped about 17% in a single session, erasing roughly $589 billion in market capitalization — at the time, the largest one-day market-cap loss any company had ever recorded. The trigger wasn't a product recall or an earnings miss. It was a free app that had just passed OpenAI's ChatGPT to become the #1 downloaded app on the US iOS App Store: DeepSeek, a chatbot built by a Chinese AI lab most of the market had never heard of a week earlier.

The panic wasn't really about the app. It was about what the lab's technical report implied: that a team outside the usual frontier labs had trained a model competitive with OpenAI's o1 on reasoning benchmarks, using a fraction of the GPUs and a fraction of the budget the market assumed was required. If that was true, the entire investment thesis behind buying ever more Nvidia GPUs — that frontier capability is gated by compute spend — looked shakier than Wall Street had priced in.

A year on, the panic has subsided, Nvidia's stock recovered, and DeepSeek is banned on government devices in several countries. But the underlying story is worth untangling carefully, because the popular version — "a $6 million model beat GPT-4" — isn't quite what happened, and the parts that are true matter more than the headline number.

What DeepSeek actually is

DeepSeek isn't a startup that raised a seed round to build AI. It's a research lab spun out in 2023 from High-Flyer, a Hangzhou-based quantitative hedge fund founded by Liang Wenfeng in 2015. High-Flyer had been using machine learning for trading since the late 2010s and had, by its own account, assembled large GPU clusters for that purpose well before the 2022 wave of generative-AI investment — including a cluster of roughly 10,000 A100s built before the first round of US export controls tightened access to that hardware. When Liang spun out DeepSeek, it was self-funded by High-Flyer rather than venture-backed, which matters: DeepSeek has never had to answer to outside investors about monetization timelines, and it has released nearly everything it trains as open weights rather than behind an API-only wall.

That funding structure is a big part of why DeepSeek behaves differently from OpenAI, Anthropic, or Google DeepMind. It doesn't need a product moat. It needs to prove a research thesis, and open-weighting the result is consistent with that goal rather than a threat to a subscription business.

The architecture: doing more with fewer active parameters

DeepSeek's models are large, but they're not dense. DeepSeek-V3, released in December 2024, has 671 billion total parameters, but only about 37 billion are active for any given token. That's a Mixture-of-Experts (MoE) design: the model has many specialized expert sub-networks, and a router selects a small subset to run per token, so inference and training compute scale with the active fraction, not the full parameter count.

The second architectural choice is Multi-head Latent Attention (MLA), introduced in DeepSeek-V2 and carried through to V3. Standard multi-head attention caches a full key and value vector per attention head for every token in context — that KV cache is what eats GPU memory as context grows. MLA instead compresses the keys and values into a shared low-rank latent vector before caching, then reconstructs the per-head projections at attention time. The cache that matters for memory and bandwidth shrinks dramatically without changing what the attention mechanism can represent.

Input token hidden state MLA compression K/V → shared low-rank latent (cache shrinks, reconstructed later) Attention output per-head projection Token + router scores every expert 256 routed experts (DeepSeek-V3) expert active (1 of 8) expert active (1 of 8) + shared experts always active · ~37B/671B params fire per token Combined expert outputs → next layer FP8 mixed precision throughout training

Both choices point the same direction: spend compute and memory only where routing or reconstruction says it's needed, rather than uniformly across a dense model. DeepSeek-V3's training run also used FP8 mixed-precision arithmetic for most matrix multiplications rather than the BF16 that was standard at the time, which further cuts memory bandwidth and lets more of the model fit in a GPU's on-chip memory at once. None of these are individually novel ideas in the literature — MoE routing and low-rank attention compression both predate DeepSeek — but the combination, executed cleanly at 671B-parameter scale and open-weighted, is what made the V3 technical report worth reading closely.

The cost number, and what it leaves out

The DeepSeek-V3 paper reported roughly 2.788 million H800 GPU-hours for the final training run, which it priced at about $5.576 million at a assumed rental rate. That figure is accurate as a description of one thing: the compute for the final pretraining run of one model. It is not, and the paper does not claim it is, the all-in cost of building DeepSeek.

It excludes the cost of the GPU cluster itself (SemiAnalysis and other research outfits estimated High-Flyer/DeepSeek's accumulated hardware investment, built up over several years and multiple cluster generations, at well over a billion dollars). It excludes every earlier architecture ablation, failed run, and research-engineer salary that went into arriving at the final recipe. It excludes the separate reinforcement-learning compute spent training DeepSeek-R1 on top of V3. And the H800 is itself a compliance workaround — Nvidia's export-control-legal variant of the H100 sold into the Chinese market, with its chip-to-chip interconnect bandwidth deliberately cut to meet US restrictions — so the GPU-hour figure describes work done on deliberately hobbled hardware, which is a different claim than "as efficient as it could be" on unrestricted hardware.

None of that makes the achievement fake. Training a 671B-parameter MoE model to GPT-4-class performance for a final run costing single-digit millions, on export-restricted chips, is genuinely a different cost curve than the dense, trillion-dollar-infrastructure story the US frontier labs had been telling. But "DeepSeek proved you can match OpenAI for $6 million" and "DeepSeek proved a specific pretraining run can be unusually compute-efficient" are different claims, and the market priced in the first one for about a week before settling on something closer to the second.

R1's actual trick: reinforcement learning without a supervised crutch

If V3 was the efficiency story, R1 — released January 20, 2025, a week before the Nvidia selloff — was the capability story. Most reasoning models up to that point, including OpenAI's o1, were trained with some combination of supervised fine-tuning on human- or model-generated chain-of-thought examples, followed by reinforcement learning. DeepSeek's team first tried something more aggressive with an intermediate model called R1-Zero: skip supervised fine-tuning entirely and train the base model with pure reinforcement learning, using an algorithm called GRPO (Group Relative Policy Optimization) and a simple rule-based reward — correct final answer, correct format — rather than a learned reward model.

R1-Zero worked, in the sense that long, structured chain-of-thought reasoning emerged from RL alone, without ever being shown an example of what good reasoning looked like. But its outputs mixed languages mid-sentence and were often unreadable. R1 itself fixed that by adding a small supervised "cold start" phase before RL, plus a later RL stage incorporating human-preference signals for readability — a hybrid that kept most of the capability gain while producing output a human would actually want to read. DeepSeek then distilled R1's reasoning behavior into much smaller dense checkpoints (1.5B up to 70B parameters, built on Qwen and Llama base models) and released those too, so a 32B distilled checkpoint could be run on a single high-end consumer GPU while still showing meaningfully better reasoning than its non-distilled base.

That distillation release is arguably more consequential than R1 itself for the open-weight ecosystem: it gave every lab and hobbyist building on Qwen or Llama a free, drop-in reasoning upgrade, which is part of why so many subsequent open-weight models adopted similar RL-based reasoning recipes within months.

Where it sits next to the alternatives

DeepSeek (V3 / R1)OpenAI (GPT-5.x / o-series)Meta Llama 4Alibaba Qwen3
WeightsOpen (MIT-style license)Closed, API-onlyOpen (custom license, usage restrictions)Open (Apache 2.0 for most sizes)
ArchitectureMoE + MLA, FP8 trainingUndisclosedMoEDense and MoE variants
Reasoning approachRL-first (GRPO), minimal SFT cold-startRL + SFT, details undisclosedSFT + RL, details undisclosedRL-based reasoning variants (Qwen3-Thinking)
Self-hostableYes, including distilled small checkpointsNoYesYes
API pricing posturePriced to undercut Western frontier APIs by roughly an order of magnitude at launchPremium, tiered by capabilityNo first-party API; priced via cloud hostsPriced aggressively, often below DeepSeek

The table understates the real tradeoff, which is less about any single row and more about what each column is optimizing for. OpenAI is selling a product and has to protect margin and a safety-and-liability story that comes with being the default choice for regulated enterprises. Meta is subsidizing Llama as a platform play to keep the open ecosystem dependent on Meta's tooling and research pipeline rather than to make money on inference. Qwen is Alibaba Cloud's wedge into enterprise AI infrastructure sales in markets where Alibaba already sells compute. DeepSeek is the odd one out: a research lab with no cloud business to cross-subsidize and no VC to answer to, open-weighting frontier-adjacent work because proving the research thesis matters more than owning the deployment.

The chip story underneath all of it

The part of the DeepSeek story that will outlast the benchmark comparisons is what it revealed about export controls. The H800 restriction was designed to let Chinese labs buy Nvidia silicon with crippled interconnect bandwidth, on the theory that interconnect-bound workloads — specifically, training runs that need fast GPU-to-GPU communication — would be hobbled enough to matter. DeepSeek's MLA and MoE choices are, among other things, architectural answers to exactly that constraint: compress what has to move between chips, and activate only a fraction of parameters per token so less needs to be communicated in the first place. Whether that was explicit strategy or a byproduct of good systems engineering, the effect is the same — it's evidence that architecture choices can partially route around a hardware restriction rather than simply absorbing its cost, which is an uncomfortable finding for export-control policy built on the assumption that compute access is the controlling variable.

The response since has been visible on both sides. US policy discussions through 2025 shifted toward tightening restrictions further rather than loosening them, while several governments — including Italy, South Korea, Australia, and Taiwan, along with US federal agencies and a number of US states — restricted or banned DeepSeek's consumer app on government devices, citing data handling (DeepSeek's app and API route data through servers subject to Chinese jurisdiction) rather than model capability. That split — restrict the app, argue about the chips — is a reasonable preview of how this keeps playing out: DeepSeek's weights are open and can be run entirely outside Chinese infrastructure by anyone with the hardware, but DeepSeek's hosted app and API are a separate, more straightforward data-sovereignty question.

What it actually signals

Strip away the market-cap headline and DeepSeek's lasting effect is structural, not a single benchmark win. It demonstrated, credibly enough to move markets, that architectural efficiency work can substitute for some amount of raw compute — which pressures every lab's capex justification, not just Nvidia's stock price. It normalized RL-heavy, SFT-light reasoning training as a viable recipe rather than a research curiosity, and that recipe diffused into the rest of the open-weight ecosystem within months because the distilled checkpoints were just sitting there to study. And it gave open-weight models a genuine frontier-adjacent entrant for the first time, which matters most for the builders and governments explicitly trying to avoid dependence on a US-based API.

The honest takeaway isn't "DeepSeek beat OpenAI for $6 million." It's that the gap between what a well-funded, compute-constrained, non-venture-backed lab can ship and what the frontier labs ship is smaller than the 2023–2024 scaling narrative implied — and that gap is a function of architecture and training recipe choices that are now public, read by every other lab's research team, and showing up in their next releases too.

#deepseek#ai-companies#open-weight-models#mixture-of-experts#ai-chips#china-ai

Related reading

AI Companies
Mistral AI, Profiled: The Product Isn't the Model, It's the Deployment Terms
AI Companies
Perplexity's Browser Bet: Why It Doubled Down on Comet the Same Summer OpenAI Killed Atlas
AI Companies
Nvidia's $20 Billion Groq Deal: How a 'Reverse Acquihire' Buys Chip Talent Without Triggering Antitrust Review