RoscoeDaWah/wah.moe
RoscoeDaWah/wah.moe
1
0
Fork 0
Code Issues Pull requests Projects Releases 17 Packages Activity Actions

Block AI scrapers

Browse source
This commit is contained in:
Frankie B 2024-05-02 13:38:12 +01:00
parent a65e1d9df7
commit cfda693788
No known key found for this signature in database
1 changed files with 16 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
public/robots.txt
View file

@ -3,3 +3,19 @@ Disallow: /admin
Disallow: /login Disallow: /login
Disallow: /js Disallow: /js
Disallow: /css Disallow: /css
User-Agent: GPTBot
Disallow: /
User-Agent: ChatGPT-User
Disallow: /
User-Agent: Google-Extended
Disallow: /
User-Agent: CCBot
Disallow: /
User-Agent: PerplexityBot
Disallow: /