Research summary
Research summary
Topic summary
Rapid commoditization of model weights has eroded frontier tech rents, distributing cost savings directly to enterprise adopters.
Key research questions
- Investigate "Who Actually Benefits From AI?" from this distinct point of divergence: Open-source commoditization and end-user surplus.
Important claims and supporting citations
An arXiv analysis of 2024–2025 LLM pricing found that algorithmic efficiency progress drove price declines roughly 3x more strongly than hardware progress or estimated competitive pricing effects.
DeepSeek-R1 was released on January 20, 2025, under an MIT license, with DeepSeek claiming a base V3 model training cost of approximately $5.6 million.
A 2026 Stanford working paper by Brynjolfsson et al. found mean consumer willingness-to-accept for generative AI rose from $98 in 2025 to $124.50 in 2026, with median rising from $3.40 to $11.40, and aggregate US consumer surplus expanding from $116 billion to $172 billion.
A leaked May 2023 internal Google memo attributed to Luke Sernau argued open-source models would erase the competitive moats of both Google and OpenAI.
Epoch AI data indicates model token price deflation varied by benchmark, ranging from 9x per year at the slowest end to 900x per year at the fastest during 2024.
Inference costs for GPT-3.5-level systems fell from $20.00 per million tokens in November 2022 to $0.07 in October 2024 (Gemini-1.5-Flash-8B), a deflation factor exceeding 280x.
Andreessen Horowitz found enterprise LLM budgets grew roughly 2 to 5 times from 2023 to 2024 despite sharp drops in per-token inference prices.
Stanford AI Index 2024 estimated the training costs for GPT-4 and Gemini Ultra at approximately $78 million and $191 million, respectively.
Competing explanations
Enterprise self-hosting of open LLMs becomes cost-effective relative to proprietary APIs above 8 to 30 million daily tokens, with 100M+ token volumes achieving 60% to 70% cost savings.
Voir toutes les affirmations (texte)
Affirmations
Claim text is for reading and citation. Bulk copying and AI training need a licensed maps data API key. Markdown
A leaked May 2023 internal Google memo attributed to Luke Sernau argued open-source models would erase the co…
A leaked May 2023 internal Google memo attributed to Luke Sernau argued open-source models would erase the competitive moats of both Google and OpenAI.
Labels: Source-linked, Low, known
Epoch AI data indicates model token price deflation varied by benchmark, ranging from 9x per year at the slow…
Epoch AI data indicates model token price deflation varied by benchmark, ranging from 9x per year at the slowest end to 900x per year at the fastest during 2024.
Labels: Source-linked, Low, known
Mark Zuckerberg stated in a July 2024 letter that Meta open-sources Llama partly to commoditize the model lay…
Mark Zuckerberg stated in a July 2024 letter that Meta open-sources Llama partly to commoditize the model layer and prevent competitors from taxing Meta's core business.
Labels: Source-linked, Low, known
Hugging Face surpassed 1 million public model repositories on its platform in 2024.
Hugging Face surpassed 1 million public model repositories on its platform in 2024.
Labels: Source-linked, Low, known
A 2022 controlled experiment reported by GitHub found software developers completed tasks up to 55% faster wh…
A 2022 controlled experiment reported by GitHub found software developers completed tasks up to 55% faster when using GitHub Copilot.
Labels: Source-linked, Low, known
An OECD 2026 analysis reported that cloud-available open-weight text models reached approximately 90% of clos…
An OECD 2026 analysis reported that cloud-available open-weight text models reached approximately 90% of closed-model quality while costing roughly 20% as much.
Labels: Inferred, Low, known
Andreessen Horowitz found enterprise LLM budgets grew roughly 2 to 5 times from 2023 to 2024 despite sharp dr…
Andreessen Horowitz found enterprise LLM budgets grew roughly 2 to 5 times from 2023 to 2024 despite sharp drops in per-token inference prices.
Labels: Source-linked, Low, known
A 2023 NBER field study by Brynjolfsson, Li, and Raymond found generative AI assistance boosted customer-supp…
A 2023 NBER field study by Brynjolfsson, Li, and Raymond found generative AI assistance boosted customer-support worker productivity by 14% on average and by 34% for novice workers.
Labels: Source-linked, Low, known
AT&T used LiteLLM to implement complexity-based query routing, reducing costs on advanced coding tasks by up…
AT&T used LiteLLM to implement complexity-based query routing, reducing costs on advanced coding tasks by up to 56% with a 2% drop in quality.
Labels: Inferred, Low, known
Vercel's July 2026 AI Gateway Production Index showed open-weight models executed 29% of June gateway tokens…
Vercel's July 2026 AI Gateway Production Index showed open-weight models executed 29% of June gateway tokens while representing under 4% of total customer spend.
Labels: Inferred, Low, known
An arXiv analysis of 2024–2025 LLM pricing found that algorithmic efficiency progress drove price declines ro…
An arXiv analysis of 2024–2025 LLM pricing found that algorithmic efficiency progress drove price declines roughly 3x more strongly than hardware progress or estimated competitive pricing effects.
Labels: Source-linked, Low, known
Stanford AI Index 2024 estimated the training costs for GPT-4 and Gemini Ultra at approximately $78 million a…
Stanford AI Index 2024 estimated the training costs for GPT-4 and Gemini Ultra at approximately $78 million and $191 million, respectively.
Labels: Source-linked, Low, known
Menlo Ventures' survey of 495 enterprise AI decision-makers in November 2025 revealed open-source models' sha…
Menlo Ventures' survey of 495 enterprise AI decision-makers in November 2025 revealed open-source models' share of enterprise LLM API spend dropped from 19% to 11% year-over-year.
Labels: Inferred, Low, known
McKinsey's 2024–2025 surveys reported over 65% of organizations regularly using generative AI, with cost redu…
McKinsey's 2024–2025 surveys reported over 65% of organizations regularly using generative AI, with cost reductions concentrated in HR, supply chain, and service operations.
Labels: Source-linked, Low, known
Andreessen Horowitz's 2024 enterprise survey found approximately 46% of respondents preferred or used open-so…
Andreessen Horowitz's 2024 enterprise survey found approximately 46% of respondents preferred or used open-source models in production deployments.
Labels: Source-linked, Low, known
Reasoning Models and Inference Evaluation Scaling
Reasoning Models and Inference Evaluation Scaling
Labels: Inferred, Low
DeepSeek Training Costs and Technical Metrics
DeepSeek Training Costs and Technical Metrics
Labels: Inferred, Low
Market Impact of DeepSeek-R1 Release
Market Impact of DeepSeek-R1 Release
Labels: Inferred, Low
Brynjolfsson Study on Generative AI Consumer Surplus
Brynjolfsson Study on Generative AI Consumer Surplus
Labels: Inferred, Low
Meta Llama Releases and Adoption
Meta Llama Releases and Adoption
Labels: Inferred, Low
Economics of Enterprise Open LLM Self-Hosting
Economics of Enterprise Open LLM Self-Hosting
Labels: Inferred, Low
A 2026 Stanford working paper by Brynjolfsson et al.
A 2026 Stanford working paper by Brynjolfsson et al. found mean consumer willingness-to-accept for generative AI rose from $98 in 2025 to $124.50 in 2026, with median rising from $3.40 to $11.40, and aggregate US consumer surplus expanding from $116 billion to $172 billion.
Labels: Source-linked, Low, known
Predibase reported that fine-tuned Llama-2 matched or outperformed GPT-4 on narrow classification benchmarks…
Predibase reported that fine-tuned Llama-2 matched or outperformed GPT-4 on narrow classification benchmarks at approximately 1/100th the inference cost.
Labels: Source-linked, Low, known
Meta released LLaMA weights for research use in February 2023, and the weights leaked on 4chan in early March…
Meta released LLaMA weights for research use in February 2023, and the weights leaked on 4chan in early March 2023.
Labels: Source-linked, Low, known
Meta reported that Llama models surpassed 1 billion cumulative downloads by March 2025, rising from approxima…
Meta reported that Llama models surpassed 1 billion cumulative downloads by March 2025, rising from approximately 650 million in December 2024.
Labels: Source-linked, Low, known
On January 27, 2025, the release of DeepSeek-R1 triggered a roughly $1 trillion intraday drop in US tech stoc…
On January 27, 2025, the release of DeepSeek-R1 triggered a roughly $1 trillion intraday drop in US tech stocks, including an approximate 17% ($589 billion) single-day decline for Nvidia.
Labels: Inferred, Low, known
Inference costs for GPT-3.5-level systems fell from $20.00 per million tokens in November 2022 to $0.07 in Oc…
Inference costs for GPT-3.5-level systems fell from $20.00 per million tokens in November 2022 to $0.07 in October 2024 (Gemini-1.5-Flash-8B), a deflation factor exceeding 280x.
Labels: Source-linked, Low, known
The cost of evaluating frontier LLMs on GPQA-Diamond, SWE-bench Verified, and AIME has increased exponentiall…
The cost of evaluating frontier LLMs on GPQA-Diamond, SWE-bench Verified, and AIME has increased exponentially at 3x to 18x per year due to increased inference requirements per task.
Labels: Inferred, Low, known
DeepSeek-R1 was released on January 20, 2025, under an MIT license, with DeepSeek claiming a base V3 model tr…
DeepSeek-R1 was released on January 20, 2025, under an MIT license, with DeepSeek claiming a base V3 model training cost of approximately $5.6 million.
Labels: Source-linked, Low, known
DeepSeek's consumer application reached the #1 spot on the US Apple App Store in late January 2025.
DeepSeek's consumer application reached the #1 spot on the US Apple App Store in late January 2025.
Labels: Inferred, Low, known
Enterprise self-hosting of open LLMs becomes cost-effective relative to proprietary APIs above 8 to 30 millio…
Enterprise self-hosting of open LLMs becomes cost-effective relative to proprietary APIs above 8 to 30 million daily tokens, with 100M+ token volumes achieving 60% to 70% cost savings.
Labels: Contested, Low, known
Brynjolfsson et al.
Brynjolfsson et al. concluded that generative AI consumer surplus substantially exceeds estimated producer revenues in the United States.
Labels: Inferred, Low, known
Self-hosting open-weight models imposes an estimated 15% to 20% operational overhead for GPU provisioning, se…
Self-hosting open-weight models imposes an estimated 15% to 20% operational overhead for GPU provisioning, serving infrastructure, monitoring, and prompt maintenance.
Labels: Inferred, Low, known
DeepSeek reported consuming 2.788 million H800 GPU-hours at a cost of $5.576 million for the final training r…
DeepSeek reported consuming 2.788 million H800 GPU-hours at a cost of $5.576 million for the final training run of its model.
Labels: Inferred, Low, known
Reasoning models' average token output length has grown 5x per year compared to 2.2x per year for traditional…
Reasoning models' average token output length has grown 5x per year compared to 2.2x per year for traditional LLMs.
Labels: Inferred, Low, known
On January 27, 2025, Larry Ellison's net worth declined by $24.9 billion and Jensen Huang's fell by $19.8 bil…
On January 27, 2025, Larry Ellison's net worth declined by $24.9 billion and Jensen Huang's fell by $19.8 billion.
Labels: Inferred, Low, known