Why Most Apps Don’t Scale (and How to Fix Them)
Most of what gets called a scaling problem has nothing to do with traffic. My text scanning app had a stretch of about seven weeks when some scans failed with “couldn’t complete this scan,” and traffic had nothing to do with it. A model upgrade slowed scans, and the slowdown showed up everywhere the system quietly assumed the model would be fast.
This is that story, plus the general mechanics behind it. The production numbers come from my monitoring and commit history. Where I use made-up numbers to show the arithmetic, I say so.
A few terms
Scalability is whether adding resources gets you proportionally more throughput, meaning more completed work per second, without making latency worse. Reliability is whether the system still gives correct answers in reasonable time while part of it is failing.
From the outside, the two look the same. An overloaded system and a hung dependency...
Copyright of this story solely belongs to hackread.com. To see the full text click HERE