AMD vibe codes its way past the CUDA moat with ROCm.AI

https://image.theregister.com/5278627.jpg?imageId=5278627&x=0&y=0&cropw=100&croph=100&panox=0&panoy=0&panow=100&panoh=100&width=1200&height=683

ai and ml

Hey Claude, optimize this model for me

Even as AMD’s GPUs have grown more competitive, the House of Zen has struggled to shake the perception that its chips are less capable because they don’t run CUDA. At its Advancing AI event in San Francisco this week, AMD unveiled ROCm.AI, which promises to let users vibe code their way to faster inference performance.

In reality, the so-called CUDA moat has become considerably shallower over the past few years as frameworks like PyTorch and JAX have made it possible for developers to write once and, for the most part, run anywhere without ever having to touch CUDA or AMD’s ROCm and HIP libraries.

But just because the code runs, it doesn’t necessarily mean it’s performant. Low-level programming interfaces like CUDA and ROCm remain key to unlocking a chip’s true potential.

However, hand tuning GPU kernels and general matrix-matrix...

Copyright of this story solely belongs to theregister.com. To see the full text click HERE

Read more