This index tracks the size of public, private and national HPC clusters, as well as the utilisation of various AI chips in AI research papers.
Public info on cluster sizes and chip use.
The Rightstack Research DB
The State of AI Report Compute Index tracks the size of public, private and national HPC clusters, as well as the utilisation of various AI chips in AI research papers. As a key substrate upon which AI models are trained and run, the size of compute clusters and the popularity of specific chips helps us take a temperature check on the rate of progress of AI systems.
A100 GPU Count
National HPC
Private Cloud
Public Cloud
Meta (US)Tesla (US)Leonardo (EU)XTX Markets (UK)Perlmutter (US)Stability.ai (UK)NVIDIA Selene (US)JUWELS (DE)Polaris (US)Hugging Face (US)Aleph Alpha (DE)Contextual.ai (US)MeluXina (EU)NVIDIA Cam-1 (UK)Narval (CA)Hessian.ai (DE)Karolina (EU)Tursa (UK)Jean Zay (FR)Recursion (US)020,00010,000500015,00021,40016,00013,82410,00061595408432037442400104810441024800640636632576456440340
Source: State of AI Report Compute Index
Notes: Public Cloud = capacity rented from hyperscalers; Private Cloud = owned and run by the company; National HPC = government owned and run
Cited chip usage in AI papers Last update: Sept 2023
All NVIDIA
TPU
ASICs
FPGAs
Huawei Ascend 910
Big 5 Startups
202320222021202020192018100,00010,0001000100101All NVIDIAAll NVIDIATPUTPUASICsASICsFPGAsFPGAsHuaweiAscend910HuaweiAscend910Big 5StartupsBig 5Startups18591859438443849830983014,66314,66320,35020,35020,91920,9193030153153231231268268178178136136717111211213913913013011811812712743543558558579979974274269569567567522441212101014149938387575151151135135140140145145
Source: State of AI Report Compute Index and Zeta Alpha
Notes: This figure presents the number of open source AI papers that cite the use of specific AI chips according to analysis by Zeta Alpha. The 2023 figure represents the annual sum extrapolated from Sept 2023
Cited NVIDIA usage in AI papers Last update: Sept 2023
2080
RTX 3090
4090
K80
P100
V100
A100
H100
Titan
Jetson
2023202220212020201920180800060004000200020802080RTX 3090RTX 309040904090K80K80P100P100V100V100A100A100H100H100TitanTitanJetsonJetson3883889109102313231330513051303230322240224000001991991191119134393439452745272482483933934644645425426696695355353433431911914774778428421163116311021102100110015885883533531626162640594059634163417388738856565656000011111174674630833083518851883131595900161161871871110811081226122616001600177177303303445445589589559559477477
Source: State of AI Report Compute Index and Zeta Alpha
Notes: This figure presents the number of open source AI papers that cite the use of specific NVIDIA chips according to analysis by Zeta Alpha. The 2023 figure represents the annual sum extrapolated from Sept 2023.
Cited AI chip startup usage in AI papers Last update: Sept 2023
Habana
Graphcore
Cerebras
Sambanova
Cambricon
20232022202120202019201805040302010HabanaHabanaGraphcoreGraphcoreCerebrasCerebrasSambanovaSambanovaCambriconCambricon00151530302424313119198815153737484848483939221111252518181414555500001111141411111111282834344848313136362323
Source: State of AI Report Compute Index and Zeta Alpha
Notes: This figure presents the number of open source AI papers that cite the use of specific AI chip startups according to analysis by Zeta Alpha. The 2023 figure represents the annual sum extrapolated from Sept 2023.
2022 Edition 2021 Edition 2020 Edition 2019 Edition 2018 Edition
Co-authored on the interwebs by:
This work is licensed under a Creative Commons Attribution 4.0 International License.