breaking the barrier: google's tpu v5p architecture (20250312)

links, etc

Introducing Cloud TPU v5p and AI Hypercomputer | Google Cloud Blog

somehow i missed the TPUv5 announcement. the specs on this are kind of bonkers. this little bit re: topology is what caught my eye. (emphasis mine)

Earlier this year, we announced the general availability of Cloud TPU v5e. With 2.3X price performance improvements over the previous generation TPU v41, it is our most cost-efficient TPU to date. By contrast, Cloud TPU v5p, is our most powerful TPU thus far. Each TPU v5p pod composes together 8,960 chips over our highest-bandwidth inter-chip interconnect (ICI) at 4,800 Gbps/chip in a 3D torus topology. Compared to TPU v4, TPU v5p features more than 2X greater FLOPS and 3X more high-bandwidth memory (HBM).