Every Distributed System Has a Brain. Here’s How It Works

https://hackernoon.imgix.net/images/HFlakj5EYZYhPovMPldW2KJJQ9G3-zba3b4u.jpeg

If you've ever wondered how a database like DynamoDB quietly re-shards itself when one partition gets hammered with traffic, or how a fleet of servers scales up before you even notice a spike, you've been wondering about the control plane. It's the part of a distributed system nobody thinks about until it breaks, and the part that's doing the most work behind the scenes to make sure it never does.

I want to walk through what the control plane actually is, what it's responsible for, and why understanding it matters if you're building anything that needs to survive contact with real-world traffic.

First, the Two Halves of Any Distributed System

At a high level, almost every large-scale distributed system, whether it's processing huge volumes of data, absorbing high transaction throughput, or both, breaks down into two components: the data plane and the control plane.

The data plane is the...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE

Read more

https://cdn.mos.cms.futurecdn.net/crwCbqY6PhFTZf8MAZtG4M-1920-80.jpg

‘If we don’t like it, we’ll kill it. If we love it, we’ll marry it’: We were dreaming about ChatGPT thousands of years before it existed — here's how ancient myths shaped the AI we’re building today

Whenever a new AI model is released in a cut-down form because it is too powerful, or one transgresses its sandbox and performs an unexpected cyber hack on a company’s website, we tend to see jokes made about Skynet or HAL 9000 becoming a reality. But science fiction didn’