TorchTPU is now open source: Run native PyTorch on TPUs

https://storage.googleapis.com/gweb-cloudblog-publish/images/AI_infrastructure_default.max-2600x2600.jpg

Mark Lohmeyer

VP & GM, AI & Computing Infrastructure

Bill Jia

Vice President, Engineering

Today at PyTorch Conference 2026, we announced a range of new products and integrations designed to help you run PyTorch effectively on Google Cloud or in your own infrastructure. Notably, TorchTPU, our native PyTorch stack for Google TPUs, is now available as open source on GitHub. With TorchTPU, TPUs join GPUs and CPUs as a native option for PyTorch. You can now train, serve, and deploy models on TPUs using the tools you already rely on, including vLLM, SGLang, llm-d, TorchTitan, Ray, TorchRec, Hugging Face, LiteRT. Ultimately, this provides our customers choice across a broad range of workload-optimized computing options including TPUs, GPUs, and CPUs, with a consistent, open software and operational model across the full portfolio.

Run PyTorch code natively on TPUs

Co-developed with the PyTorch team at Meta, TorchTPUlets you run existing PyTorch...

Copyright of this story solely belongs to cloud.google.com. To see the full text click HERE

Read more