From f926febb1a9b6a23310bf2cda61df1e39f984661 Mon Sep 17 00:00:00 2001 From: Cameron Whiteside Date: Mon, 10 Nov 2025 13:36:27 -0700 Subject: [PATCH] AI Crawl Control: hotfix example code on charging crawlers --- .../use-pay-per-crawl-as-ai-owner/crawl-pages.mdx | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/crawl-pages.mdx b/src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/crawl-pages.mdx index d791119d7cb459..0ff55e47a27f00 100644 --- a/src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/crawl-pages.mdx +++ b/src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/crawl-pages.mdx @@ -22,9 +22,9 @@ Once your AI crawler complies with Web Bot Auth, you can begin to crawl webpages When an AI crawler makes a request to a page protected by pay per crawl, the server will respond with `HTTP/2 402 Payment Required`. This response will also include the `crawler-price` header which specifies the cost to access the content. For example, a response may look like the following: ```txt -HTTP/2 200 +HTTP/2 402 date: Fri, 06 Jun 2025 08:42:38 GMT -crawler-charged: USD 0.01 +crawler-price: USD 0.01 ``` To access this content, the AI crawler must provide headers for paid access.