Open Inference Needs More Than Open Weights

Open inference without chokepoints: why open models still need an access protocol

Open model weights are not the same as open access. You can download Qwen or Llama today. But most people still reach open models through a few big hosted APIs, cloud consoles, and app stores. When one of those chokepoints blocks you or shuts down, your access goes with it.

I'm building Sovereign Inference to close that gap. It's two linked pieces. SIP-AI is a provider-neutral protocol that routes paid inference to open models. SIN is a node that runs the best model your own hardware can handle. Opt in, and it shares spare capacity with the network.

The code is public at github.com/joshuaswarren/sovereign-inference. The protocol and SDKs are Apache-2.0. The server pieces are AGPL-3.0, so a hosted fork can't quietly close them.

This post is my entry into the DecentralizeAI hackathon on HackerNoon. The contest bar...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE