Frankie B
0f52d80ca6
* Just commit it all * Require auth * crap * Update homepage * Block AI scrapers * Update cache update script * Add dummy file * Remove unnecessary lastfm config var * Use withQueryParameters for LastFM API * Fix embeds * Update example env * Smard
22 lines
259 B
Text
22 lines
259 B
Text
User-agent: *
|
|
Disallow: /admin
|
|
Disallow: /login
|
|
Disallow: /js
|
|
Disallow: /css
|
|
|
|
User-Agent: GPTBot
|
|
Disallow: /
|
|
|
|
User-Agent: ChatGPT-User
|
|
Disallow: /
|
|
|
|
User-Agent: Google-Extended
|
|
Disallow: /
|
|
|
|
User-Agent: CCBot
|
|
Disallow: /
|
|
|
|
User-Agent: PerplexityBot
|
|
Disallow: /
|
|
|