www/robots.txt
author Oleksandr Gavenko <gavenkoa@gmail.com>
Wed, 30 Dec 2020 23:13:21 +0200
changeset 2483 0b99270832a0
parent 2003 aa322acc9627
permissions -rw-r--r--
About cygdrive & usertemp FS types.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
2003
aa322acc9627 Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     1
User-agent: *
aa322acc9627 Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     2
Disallow:
aa322acc9627 Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     3
Allow: /
aa322acc9627 Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     4
aa322acc9627 Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     5
Sitemap: http://tips.defun.work/sitemap.xml
aa322acc9627 Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     6
Host: tips.defun.work