TECH NEWS

Cloudflare’s new policy pushes AI companies to pay for publishers’ content

Cloudflare has just issued the AI industry a new deadline to separate the web crawlers used for traditional search purposes, like Google Search, from those used for AI agents and training. Starting on September 15, 2026, Cloudflare’s default settings will block “mixed-use” crawlers from any pages that host ads, the company announced on Wednesday.

That means that the crawlers that blend search, agent use, and training will be blocked from crawling these sites by default, unless the site owner adjusts the settings otherwise. These changes to the defaults will apply to new Cloudflare customers, new sites set up by existing customers, and all existing free customers, the company says.

The move could impact how AI model providers are able to access web content for training purposes and to help power their agentic services.

Cloudflare points out that most website owners want their content to be discoverable via search and often...

Copyright of this story solely belongs to techcrunch.com. To see the full text click HERE

https://image.theregister.com/5241594.jpg?imageId=5241594&x=0&y=0&cropw=100&croph=100&panox=0&panoy=0&panow=100&panoh=100&width=1200&height=683

AI search could kill the web without new quality signals and revenue models

AI AND ML Penance payments to websites for failing to forward traffic aren't enough AI answers are killing content publishers, as they cause readers to stay on Google or on the chatbot of their choice, rather than navigating to dedicated websites. The end result could be catastrophic for

Future Hyundai And Kia Cars Might Never Need Air Fresheners Thanks To UV Tech

The companies have unveiled a sanitization system called Plasma Care. Hyundai and Kia recently introduced a new UV technology for in-vehicle sanitation called Plasma Care UVC. The system reduces bacteria in the cabin and can even operate while passengers are present. The companies say the technology is especially useful for

https://techcrunch.com/wp-content/uploads/2022/07/image_6483441-e1657681037469.jpg?resize=1200,780

Lime begins life as a public company after years of uncertainty

Micromobility company Lime has raised $167 million in its IPO, ending an almost decade-long run as a private company that saw wild valuation swings as it navigated multiple major hype cycles and a global pandemic. The nine-year-old scooter and bike company, which is backed by Uber, sold 6.68 million

https://techcrunch.com/wp-content/uploads/2026/07/Together-AI-founders-Percy-Liang-CEO-Vipul-Ved-Prakash-CTO-Ce-Zhang.jpg?resize=1200,800

Neocloud Together AI raises $800M, leaps to $8.3B valuation

Together AI, an AI neocloud founded in 2022, has raised an $800 million Series C at an $8.3B valuation, the company announced on Wednesday. The round was led by Aramco Ventures, with participation from Vista Equity Partners, General Catalyst, Emergence Capital, Nvidia, March Capital, Pegatron, SentinelOne’s S Ventures

Read more

AI search could kill the web without new quality signals and revenue models

Future Hyundai And Kia Cars Might Never Need Air Fresheners Thanks To UV Tech

Lime begins life as a public company after years of uncertainty

Neocloud Together AI raises $800M, leaps to $8.3B valuation