Add robots.txt with Content-Signal and sitemap reference
This commit is contained in:
parent
bc06c1e545
commit
dbd5dc2f57
1 changed files with 5 additions and 0 deletions
5
static/robots.txt
Normal file
5
static/robots.txt
Normal file
|
|
@ -0,0 +1,5 @@
|
|||
User-agent: *
|
||||
Content-Signal: ai-train=no, search=yes, ai-input=yes
|
||||
Allow: /
|
||||
|
||||
Sitemap: https://w5isp.com/sitemap.xml
|
||||
Loading…
Add table
Reference in a new issue