graham/aprs.me
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

update robots.txt

Browse source
This commit is contained in:
Graham McIntire 2026-06-04 16:26:13 -05:00
parent 5569d8e2a0
commit 2e0529ee75
No known key found for this signature in database
GPG key ID: F4ABF488E6029E59
1 changed files with 6 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
priv/static/robots.txt
View file

@ -1,7 +1,11 @@
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
# #
# To ban all spiders from the entire site uncomment the next two lines: # To ban all spiders from the entire site uncomment the next two lines:
# User-agent: *
# Disallow: / User-agent: *
Disallow: /
User-agent: AhrefsBot
Disallow: /
Sitemap: https://aprs.me/sitemap.xml Sitemap: https://aprs.me/sitemap.xml