In 30 days of groas.com edge logs, robots.txt drew 14,905 claimed AI-crawler hits but only 3,886 verified. Here’s why answer-time fetches by page tell a more useful story than raw bot counts.
| Field | Source |
|---|---|
url | customer_site |
name | customer_site |
image | customer_site |
headline | customer_site |
description | customer_site |
dateModified | customer_site |
datePublished | customer_site |
{
"@context": "https://schema.org",
"@id": "https://graph.groas.com/entity/we-counted-ai-bot-hits-for-30-days-only",
"url": "https://groas.com/post/we-logged-every-ai-bot-hit-on-our-site-f",
"name": "We Counted AI Bot Hits for 30 Days. Only 26% Verified on robots.txt",
"@type": "Article",
"image": "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/da59d007-d684-4a20-a7a3-e62e6ae1634f.png",
"headline": "We Counted AI Bot Hits for 30 Days. Only 26% Verified on robots.txt",
"description": "In 30 days of groas.com edge logs, robots.txt drew 14,905 claimed AI-crawler hits but only 3,886 verified. Here’s why answer-time fetches by page tell a more useful story than raw bot counts.",
"dateModified": "2026-11-10T21:25:19.563Z",
"datePublished": "2026-10-25T05:31:41.438Z"
}