Why continual learning and memory matters more than data in the next generation of AI
By Zuzanna Stamirowska, CEO & Co-founder, Pathway
The next leap in AI will not come from large models that wake up with amnesia. It will come from architectures that can learn through experience.
Scaling laws and the transformer architecture gave researchers a recipe: more data, more compute, more parameters. It worked. We have systems that write, code, and converse with astonishing fluency. However, it also produced a blind spot which is now getting harder to ignore. Enterprises are asking AI to run agentic workflows that span days. Governments are building national AI strategies around ever-larger data centres. All of these futures run into the same constraint: today’s models cannot accumulate experience.
Imagine two employees on their first day of work. One is brilliant but wakes up every morning having forgotten you. You leave notes on its desk so it can catch up. The other employee has the same liberty to...
Copyright of this story solely belongs to expresscomputer.in. To see the full text click HERE
