The Star Wars cantina scene shows we need a new hope for the agentic web
'We don't serve their kind here' protects today's publishers, but won't help rebels destroy the monetization Death Stars built by Google and Meta
OPINION Cloudflare CEO Matthew Prince recently reported that bots now generate more internet traffic than humans, yet few websites have undergone a redesign to accommodate both human and agentic visitors.
Clever agents find a way in regardless.
I learned this after asking Anthropic's Fable to perform some web research, a task it delegated to a squad of subagents to save me a bit of cash.
I watched those subagents work – aka "botsitting" – and approved their requests to access various websites. Eventually, the subagents surprised me with a request to visit archive.org, the Internet Archive.
I wondered why the bots would want to visit that site and decided it must be a last-ditch attempt to work around the many blocking mechanisms erected to prevent agents from...
Copyright of this story solely belongs to theregister.com. To see the full text click HERE
