groas Knowledge Graph / Article

Teardown: 30 Days of AI Crawler Logs Show Which Pages Get Fetched

A teardown of groas’s edge logs: 13,294 claimed AI bot hits on robots.txt, 3,730 verified requests, and one specific post that drew 330 live-answer fetches.

Stable URI: https://graph.groas.com/entity/teardown-30-days-of-ai-crawler-logs-show
Canonical page: https://groas.com/post/teardown-what-30-days-of-our-own-ai-craw
Last verified: 2026-11-16T07:01:32.062Z · Raw JSON-LD: teardown-30-days-of-ai-crawler-logs-show.json

Provenance

FieldSource
urlcustomer_site
namecustomer_site
imagecustomer_site
headlinecustomer_site
descriptioncustomer_site
dateModifiedcustomer_site
datePublishedcustomer_site

JSON-LD

{
  "@context": "https://schema.org",
  "@id": "https://graph.groas.com/entity/teardown-30-days-of-ai-crawler-logs-show",
  "url": "https://groas.com/post/teardown-what-30-days-of-our-own-ai-craw",
  "name": "Teardown: 30 Days of AI Crawler Logs Show Which Pages Get Fetched",
  "@type": "Article",
  "image": "https://pub-87da24ecbbfc4c3bad6875f3aa013712.r2.dev/generated-images/fae21441-cc0b-457f-834d-e523255cadbb.png",
  "headline": "Teardown: 30 Days of AI Crawler Logs Show Which Pages Get Fetched",
  "description": "A teardown of groas’s edge logs: 13,294 claimed AI bot hits on robots.txt, 3,730 verified requests, and one specific post that drew 330 live-answer fetches.",
  "dateModified": "2026-11-10T21:24:42.576Z",
  "datePublished": "2026-10-15T05:32:45.778Z"
}