Source: Search Engine Journal
Google's fragmented guidance on the llms.txt protocol—where Search dismisses it as optional while Lighthouse audits compliance for agentic AI features—leaves publishers uncertain which directive affects ranking and discoverability. Large sites can afford to hedge across multiple Google products; smaller publishers face resource constraints implementing standards that may not be enforced. The gap suggests Google is still internally negotiating how aggressive to be with autonomous AI agents accessing web content, and publishers are caught in that negotiation.