The Real Question in AI Today: Do We Need More Giant Models?
By Atul Rai, Co-founder & CEO, Staqu Technologies
Artificial intelligence has entered what appears to be a race of scale. Every few weeks, the industry sees the launch of another large language model with more parameters, more compute and marginally better benchmark scores. While these announcements generate excitement, it is worth examining whether building increasingly larger models is the most meaningful direction for AI progress.
Consider a mid-sized modern language model with roughly 30 billion parameters. Running such a model efficiently in production typically requires high-end GPU infrastructure such as the NVIDIA H100 or similar-class hardware. The model weights alone can occupy around 60 GB of memory, and once runtime buffers, inference frameworks and key-value caches are included, the practical requirement often reaches 70–90 GB.
The economics of operating such systems are revealing. A single high-end GPU instance in the cloud typically costs around $3–$4 per hour. If operated...
Copyright of this story solely belongs to expresscomputer.in. To see the full text click HERE
