How We Automated BI Content Cleanup Across Multiple Analytics Servers
Every enterprise analytics platform sooner or later faces the same challenge. More content is generated than removed. More dashboards are created. More data sources are uploaded. More workflows are launched. Projects grow. Teams evolve. People move on. But nothing much actually gets removed.
In small-scale settings, this poses little operational problem. In enterprise-scale environments, however, things become challenging quite quickly. Ineffective use of disk space becomes an issue. Scheduled refreshes continue running for weeks or months after being no longer needed. Backups continue consuming increasing amounts of resources. Performance gradually worsens.
Cleaning up seems the obvious way out. Automated deletion of unused content becomes the tempting solution.
What if something important ends up being accidentally deleted? Thousands of users will be affected, and their jobs will become a lot harder overnight.
That was the problem our engineering team had to face while working with a large analytics platform featuring 14...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
