Claude Sonnet Takes the Wheel in Doom
Artificial intelligence (AI) has been writing code, answering questions, and generating images for a while now. But thanks to a new open source project from Andrea Ricci, it can also stumble its way through the corridors of Doom running on an embedded microcontroller. The project combines an ESP32-P4 development board, the classic first-person shooter, and Anthropic's Claude Sonnet to create an AI player that experiences the game much like a human would.
The hardware platform is the SCINTIX P4, a system-on-module built around Espressif's ESP32-P4 paired with an ESP32-C6 for wireless connectivity. Doomruns directly on the board, displaying on a 7-inch 1024x600 MIPI-DSI panel. Although the game still renders at its original 320x200 resolution, the ESP32-P4's Pixel Processing Accelerator performs hardware scaling to fill the display. Offloading that work from the CPU reduced frame scaling time from roughly 24 milliseconds to about 9 milliseconds, allowing the game to maintain...
Copyright of this story solely belongs to hackster.io. To see the full text click HERE