The state of agent-readiness on the web

Nine readings of one measurement run: 1,469 sites (490 known brands across 22 categories, plus 979 long-tail sites from the Tranco list), 27 signals, no numeric score. The charts do not all use the same base: each states whether it covers the full pool (1,469), only the categorised brands (490) or the reachable sites (846). Every chart is downloadable and shareable as-is.

1469 sites · scanned September 9, 2026

Four tiers, and an overwhelming majority stalled

83% of sites: no agentic signal.

83% of the scanned sites expose no agentic signal at all: no commerce profile, no llms.txt file, no authentication metadata. Hand-picked brands do three times better than the web's long tail (30% above “not ready” versus 10%), but “fully optimised” stays the exception: 23 sites out of 1,469.

Four tiers, and an overwhelming majority stalled — canagentsbuyfromyou.com/datacanagentsbuyfromyouFour tiers, and an overwhelming majority stalledHow the 1,469 sites fall across the Agent Readiness tiersFull pooln=146984%Not ready1,228 · 84%11%Almost ready158 · 11%Agent Ready60 · 4%Fully optimized23 · 2%Curated brandsn=49070%Not ready342 · 70%20%Almost ready97 · 20%6%Agent Ready31 · 6%Fully optimized20 · 4%Long tail (Tranco)n=97991%Not ready886 · 91%6%Almost ready61 · 6%Agent Ready29 · 3%Fully optimized3 · 0%Not readyAlmost readyAgent ReadyFully optimizedcanagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08

Across all 1,469 sites in the full pool

1469 sites measured
83.6% at the “not ready” tier
5.7% “Agent Ready” or above
1 site in 18 reaches “Agent Ready”
61.4% of the 51 sites at the top are curated brands
Download SVG

Source: leaderboard pool, 1469 domains, scanned 2026-09-08.

Who is ready, who is not

Collaboration SaaS 79% · food delivery and public sector 0%.

Productivity SaaS, developer tools and CRM lead — sectors whose product is already, in essence, an API. At the other end, food delivery and the public sector sit at zero: not one of the 40 sites scanned in those two categories exposes a single agent-usable signal.

Who is ready, who is not — canagentsbuyfromyou.com/datacanagentsbuyfromyouWho is ready, who is notShare of sites above “not ready” — across the 490 sites classified by line of businessSaaS — productivity & collaborationSaaS — productivity & collaboration19/24 · 79%79%Developer tools / DevOpsDeveloper tools / DevOps16/24 · 67%67%AI / Agent toolsAI / Agent tools13/22 · 59%59%CRM / Sales / Marketing techCRM / Sales / Marketing tech14/24 · 58%58%Fintech / PaymentsFintech / Payments14/25 · 56%56%Enterprise software / ERP / HREnterprise software / ERP / HR10/21 · 48%48%EdTech / Online learningEdTech / Online learning9/20 · 45%45%Cloud / Infrastructure / HostingCloud / Infrastructure / Hosting8/23 · 35%35%Logistics / DeliveryLogistics / Delivery6/20 · 30%30%E-commerce — marketplaces & platformsE-commerce — marketplaces & platforms6/25 · 24%24%Social networksSocial networks5/23 · 22%22%E-commerce — retailers & brands (D2C)E-commerce — retailers & brands (D2C)6/30 · 20%20%Travel / Hospitality / MobilityTravel / Hospitality / Mobility5/25 · 20%20%Real estate / ClassifiedsReal estate / Classifieds3/19 · 16%16%Banking / Insurance (incumbents)Banking / Insurance (incumbents)3/20 · 15%15%Telecom / ConnectivityTelecom / Connectivity3/20 · 15%15%Gaming / Interactive entertainmentGaming / Interactive entertainment3/20 · 15%15%Media / News / PublishingMedia / News / Publishing3/25 · 12%12%Streaming / EntertainmentStreaming / Entertainment1/20 · 5%5%Health / Wellness / Pharma D2CHealth / Wellness / Pharma D2C1/20 · 5%5%Food delivery / Grocery / Q-commerceFood delivery / Grocery / Q-commerce0/20 · 0%0%Public sector / Government servicesPublic sector / Government services0/20 · 0%0%canagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 490 domains, scanned 2026-09-08.

One signal everywhere, the rest almost nowhere

sitemap 73% → llms.txt 21% → everything else under 8%.

The XML sitemap, inherited from classic SEO, is on 73% of sites — but it says nothing about agentic intent. The first genuine agentic signal, llms.txt, is at 21%. Below that the drop is steep: OAuth metadata under 8%, and the newest conventions (MCP, WebMCP, Web Bot Auth) on a handful of domains.

One signal everywhere, the rest almost nowhere — canagentsbuyfromyou.com/datacanagentsbuyfromyouOne signal everywhere, the rest almost nowherePrevalence of each signal among the 846 reachable sites in the full poolXML sitemap (sitemap.xml)XML sitemap (sitemap.xml) — diagnostic only619/846 · 73.2%73.2%JSON-LD structured dataJSON-LD structured data — diagnostic only389/846 · 46.0%46.0%Organization and Schema.org type breadthOrganization and Schema.org type breadth — diagnostic only318/846 · 37.6%37.6%llms.txt filellms.txt file — counts toward the tier177/846 · 20.9%20.9%OAuth discovery (authorization server)OAuth discovery (authorization server) — counts toward the tier60/846 · 7.1%7.1%OAuth discovery (protected resource)OAuth discovery (protected resource) — counts toward the tier45/846 · 5.3%5.3%Link to technical documentation from the ho…Link to technical documentation from the homepage — diagnostic only41/846 · 4.8%4.8%Markdown content negotiationMarkdown content negotiation — counts toward the tier40/846 · 4.7%4.7%agents.md fileagents.md file — diagnostic only36/846 · 4.3%4.3%Content-Signal policyContent-Signal policy — counts toward the tier34/846 · 4.0%4.0%API catalog (Linkset)API catalog (Linkset) — counts toward the tier27/846 · 3.2%3.2%Pricing accessible in structured dataPricing accessible in structured data — diagnostic only23/846 · 2.7%2.7%"When to use" section written for agents"When to use" section written for agents — diagnostic only20/846 · 2.4%2.4%Link header to API catalogLink header to API catalog — counts toward the tier20/846 · 2.4%2.4%Skills index (Agent Skills)Skills index (Agent Skills) — counts toward the tier17/846 · 2.0%2.0%Published OpenAPI specificationPublished OpenAPI specification — diagnostic only12/846 · 1.4%1.4%auth.md fileauth.md file — counts toward the tier8/846 · 0.9%0.9%A2A agent cardA2A agent card — counts toward the tier4/846 · 0.5%0.5%WebMCP (navigator.modelContext)WebMCP (navigator.modelContext) — counts toward the tier4/846 · 0.5%0.5%MCP server cardMCP server card — counts toward the tier3/846 · 0.4%0.4%Bot authentication (Web Bot Auth)Bot authentication (Web Bot Auth) — counts toward the tier1/846 · 0.1%0.1%counts toward the tierdiagnostic onlycanagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 846 domains, scanned 2026-09-08.

What robots.txt declares, what the server does

53% of “I block AI” block nothing. 17% of “open” ones block.

One in two sites that declare they block AI robots in robots.txt in fact treat no AI crawler differently from an ordinary browser (66 of 125 measured). The reverse also happens: 17% of domains that declare nothing, or say they are open, still block at least one crawler. The declaration and the real behaviour are two different things. The broad campaign of 2026-08-24 measures the same gap with a looser criterion, and agrees.

What robots.txt declares, what the server does — canagentsbuyfromyou.com/datacanagentsbuyfromyouWhat robots.txt declares, what the server doesDomains that in fact treat no AI crawler differently, by what robots.txt declaresdeclares a block66/125 · 53%robots.txt : 17053%66 / 125declares a blockrobots.txt : 170declares open69/82 · 84%robots.txt : 9684%69 / 82declares openrobots.txt : 96names no AI robot417/526 · 79%robots.txt : 60679%417 / 526names no AI robotrobots.txt : 606no robots.txt46/55 · 84%robots.txt : 8084%46 / 55no robots.txtrobots.txt : 80treats no AI crawler differentlydomains with measured behaviourCorroboration (broad campaign, 2026-08-24): 56.8% of the “declares a block” stratum in fact blocks nothing.canagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 788 domains, scanned 2026-09-08.

The jump between “almost ready” and “agent ready”

144 sites at a single signal. 13 have two, but in the same category.

Clearing the “agent ready” tier does not take more signals, but signals of a different nature: at least two distinct categories. 13 sites have two signals in a single category and stay stuck at “almost ready”; 24 sites with two signals split across two categories tip over. The most crowded cell is still (1 signal, 1 category): 144 sites, almost always llms.txt alone.

The jump between “almost ready” and “agent ready” — canagentsbuyfromyou.com/datacanagentsbuyfromyouThe jump between “almost ready” and “agent ready”Site count by (signals present × signal categories touched)1234signal categories touched12345678910signals present14413243141121329411144 sites: 1 signal, 1 category 158Almost ready 60Agent Ready 23Fully optimizedcanagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 241 domains, scanned 2026-09-08.

“This site has an npm SDK”: a signal wrong one time in four

25% false positives, 19% verified official SDKs.

Searching a brand name on the npm registry and taking the first result yields a false positive 25% of the time: an unrelated same-name package (samsung → @browser-logos/samsung-internet, zoom.us → @types/d3-zoom). Only 19% are a verifiable official SDK. That is why this signal stays diagnostic and never has a “present” state.

“This site has an npm SDK”: a signal wrong one time in four — canagentsbuyfromyou.com/datacanagentsbuyfromyou“This site has an npm SDK”: a signal wrong one time in fourReliability of the top npm search result, 32-brand pilot18.8%25.0%56.3%32 brands testedverified official SDK — 6/32false positive (same name) — 8/32legitimate third-party package — 18/32Observed false positives:samsung.com → @browser-logos/samsung-internetzoom.us → @types/d3-zoomsubstack.com → substack (utilitaire homonyme)canagentsbuyfromyou.com/dataseparate sample · 32 domains · 2026-08-25
Download SVG

Source: pilote 32 domaines choisis pour porter un nom de marque reconnaissable (orienté tech/SaaS) (32 domains, 2026-08-25) — a sample distinct from the leaderboard pool.

NoteN=32, sur-représentation délibérée d'entreprises tech/SaaS susceptibles d'avoir un SDK — un point de mesure de la fiabilité du signal, pas une prévalence populationnelle. Ventilation officiel / faux positif / tiers légitime issue d'une revue manuelle du premier résultat npm.

Competing agentic payment protocols: zero adoption

ACP: 0 / 1000. x402: 0 / 1000. Named adopters: 0 / 7.

Probed blind across 1,000 domains and at seven publicly named adopters, neither ACP (OpenAI) nor x402 (Coinbase) serves a single valid discovery document. Anthropic's commerce blueprint of 2026-09-02 cites no third-party payment protocol — it builds on UCP, the Catalog and Sign in with Shop.

Competing agentic payment protocols: zero adoption — canagentsbuyfromyou.com/datacanagentsbuyfromyouCompeting agentic payment protocols: zero adoptionDiscovery documents served — Tranco sample n=1000 and named adoptersACP0 / 1000valid ACP documents / 1000x4020 / 1000structured x402 documents / 1000ACP0 / 7named ACP adopters serving the documentAnthropic's commerce blueprint (2026-09-02) cites no third-party payment protocol.canagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 1000 domains, scanned 2026-09-08.

NoteÉchantillon Tranco généraliste, distinct du pool leaderboard curé — mais le résultat mesuré est « zéro » (0 document ACP valide, 0 document x402 structuré), robuste à la composition de l'échantillon. AP2 et MPP ne sont pas sondables en aveugle et restent en desk-research.

UCP, the only protocol with measurable merchant adoption

4 real UCP profiles out of 55. Competing protocols with merchant docs: 0.

Of 55 e-commerce sites tested, four expose a complete, queryable UCP profile: allbirds, decathlon, glossier, gymshark. That is few, but it is four more than every competing protocol combined, none of which has usable merchant documentation. The direction is set by the Anthropic × Shopify announcement of September 2026.

UCP, the only protocol with measurable merchant adoption — canagentsbuyfromyou.com/datacanagentsbuyfromyouUCP, the only protocol with measurable merchant adoptionValid UCP profiles found in the commerce pool, against competing protocolsUCPmeasurable adoptionACPzerox402zeroAP2zeroMPPzero4 valid UCP profiles out of 55 e-commerce sites testedallbirds.com · decathlon.com · glossier.com · gymshark.comCompeting protocols with usable merchant documentation: 0.“Building Commerce Agents with Claude” — 2026-09-02Anthropic's commerce blueprint cites: UCP, Catalog, Sign in with Shop.canagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 55 domains, scanned 2026-09-08.

What an agent finds on the surface, by kind of convention

Discoverability 43% · API / Auth / MCP surface 9%.

Distinct from the ranking by line of business: here, the four families of agent-facing conventions. Sites do the passive work — making themselves discoverable (43%), making their content readable (29%), declaring a policy for robots (27%). Almost none expose the active surface: an API, authentication or an MCP connector an agent can actually call (9%).

What an agent finds on the surface, by kind of convention — canagentsbuyfromyou.com/datacanagentsbuyfromyouWhat an agent finds on the surface, by kind of conventionSites in the full pool (1,469) with at least one active convention, by technical categoryDiscoverabilityDiscoverability635 / 1,469 · 43.2%43.2%635 / 1,469Content accessibilityContent accessibility427 / 1,469 · 29.1%29.1%427 / 1,469Bot access controlBot access control396 / 1,469 · 27.0%27.0%396 / 1,469API / Auth / MCPAPI / Auth / MCP126 / 1,469 · 8.6%8.6%126 / 1,469canagentsbuyfromyou.com/dataleaderboard pool · 1469 domains · scanned 2026-09-08
Download SVG

Source: leaderboard pool, 1469 domains, scanned 2026-09-08.

Methodology: how the tier is computed