TECH NEWS
I Built a Tiny GPT That Speaks Sanskrit in a Weekend — Here’s What Broke
A from-scratch transformer, ~250 lines of Python, and one Unicode lesson that humbled me. GitHub repository link I’ve understood transformers “at a high level” for a while now. Attention, embeddings, the usual diagram with the arrows. But I’d never built one. And there’s a specific kind of