Google unveils TPU 8tx for confidential computing and the dual-chip TPU 8i Max
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Cloud SI is gaining more specialized hardware: agents with massive contexts and sensitive data will be able to run more efficiently without relying solely on Nvidia GPUs.
Google has expanded its eighth-generation TPU portfolio with two systems. TPU 8tx uses TPU 8t silicon and fifth-generation AMD EPYC processors: data and model weights remain encrypted and isolated even while being processed. The Boardfly network reduces latency by up to two times compared with TPU 8t, while one system can handle confidential inference, fine-tuning and reinforcement learning for agents. TPU 8i Max combines two TPU 8i chips in one package and doubles compute, SRAM capacity and HBM bandwidth for long-context workloads. These are new system configurations rather than new chips: the modular architecture allowed Google to introduce four TPU systems in a single year. The company also released tools for porting PyTorch code and Hugging Face models to TPUs. TPU Sync combines memory across chips, hosts and storage; according to Google, it reduces KV-cache transfer latency and time to first token by more than 90%.
Sources 2