State of AI Report Compute Index
🏠 Home 📧 Air Street PresThe State of AI Report Compute Index tracks the size of public, private and national HPC clusters, as well as the utilisation of various AI chips in AI research papers. As a key substrate upon which AI models are trained and run, the size of compute clusters and the popularity of specific chips helps us take a temperature check on the rate of progress of AI systems.
A100 GPU Count Last update: Nov 2024
Notes: Public Cloud = capacity rented from hyperscalers; Private Cloud = owned and run by the company; National HPC = government owned and run. Source document.
H100 GPU Count Last update: November 2024
Notes: Public Cloud = capacity rented from hyperscalers; Private Cloud = owned and run by the company; National HPC = government owned and run. Meta's H100 figure represents its H100 purchase as per company earnings call 1 Feb 2024. Excludes a further 250,000 H100 equivalents worth of GPU. Source document.
Cited chip usage in AI papers Last update: Sept 2024
Notes: This figure presents the number of open source AI papers that cite the use of specific AI chips according to analysis by Zeta Alpha. The "Big 6 Startups" category includes Habana, Graphcore, Cerebras, SambaNova Systemes, Cambricon and Groq. The 2024 figure represents the annual sum extrapolated from 1 Sept 2024.
Cited NVIDIA usage in AI papers Last update: Sept 2024
Notes: This figure presents the number of open source AI papers that cite the use of specific NVIDIA chips according to analysis by Zeta Alpha. The 2024E figure represents the annual sum extrapolated from 1 Sept 2024.
Cited AI chip startup usage in AI papers Last update: Sept 2024
Notes: This figure presents the number of open source AI papers that cite the use of specific AI chip startups according to analysis by Zeta Alpha. The 2024E figure represents the annual sum extrapolated from 1 Sept 2024.
Authored on the interwebs by:
This work is licensed under a Creative Commons Attribution 4.0 International License.