Your BI Platform Has Five Monitoring Tools and No Observability

https://hackernoon.imgix.net/images/Qf6lUUIjUXgoY9A1lwU78zVkSUf2-4r83aim.png

I have spent eighteen years keeping enterprise systems running, and most of the last several of them on a global business intelligence platform that sits under a Fortune 500 company's reporting, forecasting, and planning. Every line of business touches it. When it is late, people notice within minutes.

The platform is not one thing. It is a relational warehouse, an in-memory column store, a cloud data platform, a streaming layer, and a distributed SQL engine, plus the schedulers and integration middleware holding them together. Each of those components ships with good monitoring. Each of them will tell you, in detail, that it is fine.

And they can all be fine while the number on the executive dashboard is wrong.

That gap is the actual operational problem in large analytics platforms, and I do not think most teams have named it yet. We bought monitoring per engine. We never bought observability...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE

Read more

https://cdn.mos.cms.futurecdn.net/U76sZeRd6fS2fKt5RqBYPL-2560-80.jpg

Quote of the day by ARC Prize co-founder François Chollet: 'OpenAI basically set back progress to AGI by five to 10 years' — critiquing the industry's overindulgence in large language models

Many AI developers and frontier labs are openly pursuing artificial general intelligence (AGI), which scientists describe as human-like intelligence in which a model can reason like humans and learn new capabilities outside its training data. But does that mean that they're all on the right path? Chasing the