riki/treehouse
riki/treehouse
1
Fork 0
Code Issues 33 Activity

rudimentary search engine optimisation (robots.txt, <meta name="robots"> in /b)

Browse source
This commit is contained in:
りき萌 2024-11-24 14:28:34 +01:00
parent 107a9a4c39
commit 41fa245150
3 changed files with 16 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

11
static/robots.txt Normal file
View file

@ -0,0 +1,11 @@
# This file is mirrored under /robots.txt and /static/robots.txt.
User-Agent: *
# /static does not contain any pages.
Disallow: /static
# /_treehouse contains system pages such as the 404 page.
Disallow: /_treehouse
# In addition to this, some system pages contain a <meta name="robots" content="noindex"> tag to
# prevent them from appearing in search results.