OpenAI lifts the lid on its in-house Jalapeño chip - with benchmarks claiming it beats Nvidia's GB300

• OpenAI published the first Jalapeño benchmarks at Hot Chips, claiming 1.5 to 1.9x more throughput per kilowatt and up to 3.6x lower latency than Nvidia's GB200 and GB300 rack systems
• The chip's purported gains are at a reported 700W power draw and center around efficiency, with Nvidia's GB300 still leading on absolute throughput per package by 20-25 percent.
• The numbers are currently self-reported, and volume production of the chip is not expected to ramp up until 2027

OpenAI took the stage at Hot Chips on August 25 with the first published performance figures for Jalapeño, the inference accelerator it co-developed with Broadcom, and the numbers are designed to be read the way it flatters the former: efficiency.

The company reported 1.5 to 1.9 times more throughput per kilowatt and 1.7 to 3.6 times lower end-to-end latency across three open models than the Nvidia rack systems it tested against.

OpenAI's Jalapeño...

Copyright of this story solely belongs to techradar.com. To see the full text click HERE