Did we build the engine before we worked out the physics? What's the pathway to take after the LLM transformer?

The AI boom was built on top of the transformer model first discovered in 2017 for better translation. The stock valuations, planned multi-gigawatt data centers, and the whole AI economy now exist because transformers unlocked the ability to automatically train AI models on human language at scale. Pretty much all of the hype builds on this seminal technology because it opened the ability to process unstructured data in new ways to do pretty much everything people are talking about today - coding, agents, harnesses, digital twins, 'reasoning', content generation, and the list goes on.

That said, it's still early days for applying AI to unstructured data because actually building something useful depends on a lot of what is essentially baling wire and duct tape to keep the whole AI vehicle in motion on a rocky road ahead. Context engineering, RAG, harnesses, tokenomics and fine-tuning are some of the more prominent...

Copyright of this story solely belongs to diginomica.com. To see the full text click HERE