Modern AI performance is set by the whole system: accelerators, high-bandwidth memory, networking and software. If one layer cannot scale, expensive compute units sit idle, so nominal FLOPS are not the same as usable capacity.
Source: NVIDIA · Rubin platformAccelerator and memory scarcity
About this eventLeading accelerator and HBM production remains concentrated and cannot instantly follow demand.