www/robots.txt
author Oleksandr Gavenko <gavenkoa@gmail.com>
Tue, 23 Aug 2016 22:40:02 +0300
changeset 83 41a9c64f3fb7
parent 80 9a1292a6be3e
child 85 1d4f704e40ee
permissions -rw-r--r--
Clean up after moving cooking.rst from tips project. Remove iframe, fix build.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
80
9a1292a6be3e Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     1
User-agent: *
9a1292a6be3e Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     2
Disallow:
9a1292a6be3e Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     3
Allow: /
9a1292a6be3e Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     4
9a1292a6be3e Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     5
Sitemap: http://tips.defun.work/sitemap.xml
9a1292a6be3e Add robots.txt.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     6
Host: tips.defun.work