OpenAI And Broadcom Reveal Jalapeño AI Chip To Bring The Heat To NVIDIA
OpenAI spent years buying other people's silicon, but it just showed off its own chip, and the codename packs a little kick. The company teamed with Broadcom to reveal Jalapeño, a custom AI chip built specifically for inference. Broadcom CEO Hock Tan walked into OpenAI's offices and handed the first wafer to Sam Altman and Greg Brockman, in a photo op that doubled as a statement of intent.
Running ChatGPT at planetary scale on rented hardware is expensive, and most of that hardware traces back to one supplier. Leaning on NVIDIA's GPUs has worked well enough to this point, but it leaves OpenAI paying a premium on every query and jockeying with the entire industry for supply. A custom-designed chip helps solve both problems.
OpenAI built an unusually large compute element and paired it with high-bandwidth memoryto maximize compute, minimize data movement and keep those cores fed. TSMC...
Copyright of this story solely belongs to hothardware.com. To see the full text click HERE
