Meta's new MTIA 400 chip has a split personality: Training AI and serving ads
Faster than Blackwell, but still no replacement for AMD or Nvidia ... yet
If you’re going to build a custom AI accelerator, inference is a good place to start. The clusters are smaller, the chips can be simpler, and at the end of the day they only need to do one thing: serve tokens. OpenAI’s spicy new Jalapeño inference chips are just the latest example.
Social media magnate Meta is bucking this trend. Its first proper generative AI accelerator, the MTIA 400 — short for Meta Training and Inference Accelerator — is aimed squarely at LLM training.
The Facebook parent is no stranger to custom silicon. But, much like Amazon and Google, its first AI accelerators weren’t built to run AI chatbots or train generative AI models. They were built to serve ads.
The MTIA 400, teasedearlier this year and detailed at the annual Hot Chips semiconductor development conference...
Copyright of this story solely belongs to theregister.com. To see the full text click HERE
