Using TPC-DS to Compare Cloud Data Engines by Price Performance
Cloud vendors are very good at benchmarks. Every platform has a chart showing why its engine is faster, cheaper, or both. The problem is that those numbers are usually produced under conditions chosen by the vendor.
I needed a different kind of answer. I was comparing several cloud processing options for a large data organization, and the decision could affect thousands of pipelines. I could not base that choice on a slide deck or a one-off test from a single team. I needed a benchmark that was neutral, repeatable, and easy to run across very different systems.
That is what pushed me toward TPC-DS. Instead of asking which vendor had the best story, I ran the same analytical workload across multiple engines and measured the thing the business actually cared about: how much useful performance we received for the cost of running it.
Why Vendor Benchmarks Are Hard to Trust
...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
