wah.moe/public/robots.txt

5 lines
160 B
Text
Raw Normal View History

2024-09-13 11:58:12 +00:00
# Learn more about robots.txt: https://www.robotstxt.org/robotstxt.html
2023-06-13 20:59:16 +00:00
User-agent: *
2024-09-13 11:58:12 +00:00
# 'Disallow' with an empty value allows all paths to be crawled
Disallow: