Chain-of-Thought Monitoring Is Now Costing 20% of AI Compute: Someone's Going to Bill You For It

https://hackernoon.imgix.net/images/AMqqeBm4qFS32MeRJPcWyAejo2T2-bf82bn4.jpeg

Every abstraction layer in software eventually develops its own tax.

Cloud added an observability tax somewhere between 2013 and 2016, when Datadog, New Relic, Splunk, and the rest quietly became line items running 15 to 30 percent on top of raw infrastructure spend. Nobody planned for that when they were migrating off bare metal. It just accumulated. By the time finance noticed, it was baseline overhead.

Kubernetes added a platform tax around 2018. Service meshes added a service mesh tax around 2020. Every layer of abstraction reaches a moment where the thing that makes it viable in production- the observability, the security, the compliance, the audit trail- becomes a real percentage of the compute bill. The teams that model that tax into their planning from day one end up fine. The teams that assume it away end up in awkward all-hands meetings.

AI just had that moment. Yesterday.

The Disclosure

...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE

Read more

https://cdn.mos.cms.futurecdn.net/YCza38ys4nD6jstSckhs8R-1920-80.jpg

I tested Soundcore’s new headphones and ANC doesn’t get much better at this price-point — but their middling sound quality and downgraded battery life left me thinking Nothing and Sony can do it better, at the level

The Anker Soundcore Space 2 Pro feel a bit messy. While they offer some of the best ANC and call quality I’ve experienced at this price-point, their overzealous bass, weakened battery life, and hilariously bad AI Chat integration mean that they fail to be the perfect upgrade over their