RoscoeDaWah/wah.moe
RoscoeDaWah/wah.moe
1
0
Fork 0
Code Issues Pull requests Projects Releases 23 Packages Activity Actions

Update robots.txt

Browse source
This commit is contained in:
floppydiskette 2024-12-28 16:37:43 +00:00
commit 51beb44c30
1 changed files with 8 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
public/robots.txt
View file

@ -19,3 +19,11 @@ Disallow: /
User-Agent: PerplexityBot
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: ClaudeBot
Disallow: /