Add robots.txt with Content-Signal and sitemap reference
This commit is contained in:
parent
bc06c1e545
commit
dbd5dc2f57
1 changed files with 5 additions and 0 deletions
5
static/robots.txt
Normal file
5
static/robots.txt
Normal file
|
|
@ -0,0 +1,5 @@
|
||||||
|
User-agent: *
|
||||||
|
Content-Signal: ai-train=no, search=yes, ai-input=yes
|
||||||
|
Allow: /
|
||||||
|
|
||||||
|
Sitemap: https://w5isp.com/sitemap.xml
|
||||||
Loading…
Add table
Reference in a new issue