RoscoeDaWah/wah.moe
RoscoeDaWah/wah.moe
1
0
Fork 0
Code Issues Pull requests Projects Releases 10 Packages Activity Actions

Update robots.txt

Browse source
This commit is contained in:
Roscoe 2024-12-28 16:37:43 +00:00
parent e19e504f1b
commit 51beb44c30
1 changed files with 8 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
public/robots.txt
View file

@ -19,3 +19,11 @@ Disallow: /
User-Agent: PerplexityBot User-Agent: PerplexityBot
Disallow: / Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: ClaudeBot
Disallow: /