In 30 days of edge logs, 14,905 robots.txt fetches claimed AI crawler identities; 3,886 passed verification. Here’s what agencies should report instead of raw hits.
| Field | Source |
|---|---|
url | customer_site |
name | customer_site |
image | customer_site |
headline | customer_site |
description | customer_site |
dateModified | customer_site |
datePublished | customer_site |
{
"@context": "https://schema.org",
"@id": "https://graph.groas.com/entity/only-26-of-our-claimed-ai-bot-fetches-we",
"url": "https://groas.com/post/26-of-the-ai-bot-traffic-on-our-site-was",
"name": "Only 26% of Our Claimed AI Bot Fetches Were Verified",
"@type": "Article",
"image": "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/e9671257-29ba-49d4-96cf-cacffd2229fa.png",
"headline": "Only 26% of Our Claimed AI Bot Fetches Were Verified",
"description": "In 30 days of edge logs, 14,905 robots.txt fetches claimed AI crawler identities; 3,886 passed verification. Here’s what agencies should report instead of raw hits.",
"dateModified": "2026-11-10T21:18:56.736Z",
"datePublished": "2026-10-25T05:25:28.827Z"
}