Why your startup needs open models alongside frontier APIs

https://storage.googleapis.com/gweb-cloudblog-publish/images/open-models-for-startups-gemma-header.max-2500x2500.png

Every week, I talk with founders who are building at an unbelievable pace. Teams are moving from inception to product-market fit faster than ever, with foundation models wired deeply into their core product workflows.

Yet as startup architectures mature, a clear divide has emerged between teams struggling with margins and those scaling sustainably. The most effective engineering teams have abandoned the one-size-fits-all model strategy.

In the early days of LLMs the default architecture was simple: send every interaction to the largest model available. But as applications move into production, serving millions of people and running autonomous multi-agent workflows, relying on a single frontier model starts to strain in three places:

  • Latency penalties: Relying entirely on cloud round trips makes it difficult to deliver the sub-second responsiveness that interactive mobile and desktop apps require.
  • Infrastructure overhead: Self-hosting large open models with more than 70 billion parameters forces early-stage teams to act...

Copyright of this story solely belongs to cloud.google.com. To see the full text click HERE

Read more

https://images.axios.com/ZRWdFls_uskD1bDSgl56XVdWTPg=/0x0:1920x1080/1366x768/2025/10/15/1760555117414.jpeg

Seattle-based StepSecurity, which offers a software supply chain security platform, raised a $20M Series A led by Elephant, bringing its total funding to $23M

Featured Podcasts Big Technology Podcast: Why The Anthropic IPO Will Succeed — With Aaron Levie The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Subscribe to Big Technology Podcast. Great Chat: Reminder: Tweeting is optional A podcast mostly about