Your BI Platform Has Five Monitoring Tools and No Observability
I have spent eighteen years keeping enterprise systems running, and most of the last several of them on a global business intelligence platform that sits under a Fortune 500 company's reporting, forecasting, and planning. Every line of business touches it. When it is late, people notice within minutes.
The platform is not one thing. It is a relational warehouse, an in-memory column store, a cloud data platform, a streaming layer, and a distributed SQL engine, plus the schedulers and integration middleware holding them together. Each of those components ships with good monitoring. Each of them will tell you, in detail, that it is fine.
And they can all be fine while the number on the executive dashboard is wrong.
That gap is the actual operational problem in large analytics platforms, and I do not think most teams have named it yet. We bought monitoring per engine. We never bought observability...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE