2026-10-31 · AI Models
Google, Anthropic and others to support new AI crawling opt-out standard
/news/google-anthropic-and-others-to-support-new-ai-crawling-opt-out-s1 sources
This story was reported by 1 of the feeds we follow. Read the originals below — we link the source rather than rewriting it, so you can check the claim yourself.
- SiliconANGLEsiliconangle.com/2026/10/30/google-anthropic-and-others-to-s
what it means for your site
A new model means a new set of answers. What decides whether your page is part of them does not change: the crawler has to be allowed in, and the page has to carry a paragraph someone can lift. The scan checks both in twelve seconds.
more on this
- The OpenAI board member who fired Sam Altman says we still can’t trust AI CEOs
- Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol
- Cmpnd Releases dspy-wsp: Weight-Space Programming Comes to DSPy
- Anthropic CEO Amodei admits "there's a huge uncertainty in what's going to happen next year" days before a record IPO