From 51beb44c3096b08c96ca38dafac693ac30adf75f Mon Sep 17 00:00:00 2001 From: floppydiskette Date: Sat, 28 Dec 2024 16:37:43 +0000 Subject: [PATCH] Update robots.txt --- public/robots.txt | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/public/robots.txt b/public/robots.txt index 582552d..ccc50e1 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -19,3 +19,11 @@ Disallow: / User-Agent: PerplexityBot Disallow: / +User-agent: anthropic-ai +Disallow: / + +User-agent: Claude-Web +Disallow: / + +User-agent: ClaudeBot +Disallow: /