web-site.rst
changeset 1324 05861a2b18d8
parent 1323 1d94538d70c9
child 1325 ea51f96a6a47
--- a/web-site.rst	Fri Jul 06 21:52:15 2012 +0300
+++ /dev/null	Thu Jan 01 00:00:00 1970 +0000
@@ -1,58 +0,0 @@
--*- mode: outline; coding: utf-8 -*-
-
-* Speeding up web site loading.
-
-  http://developer.yahoo.com/performance/rules.html
-
-* robots.txt.
-
-To exclude all robots from the entire server
-
-  User-agent: *
-  Disallow: /
-
-To exclude all robots from part of the server:
-
-  User-agent: *
-  Disallow: /cgi-bin/
-  Disallow: /tmp/
-  Disallow: /junk/
-
-To allow a single robot:
-
-  User-agent: Google
-  Disallow:
-
-  User-agent: *
-  Disallow: /
-
-To allow all robots complete access:
-
-  User-agent: *
-  Disallow:
-
-  http://www.robotstxt.org/
-                home page
-  http://www.robotstxt.org/robotstxt.html
-                About /robots.txt
-  http://www.robotstxt.org/faq.html
-                Frequently Asked Questions
-  http://googlewebmastercentral.blogspot.com/2008/06/improving-on-robots-exclusion-protocol.html
-                Improving on Robots Exclusion Protocol
-
-* Web document structure useage.
-
-  http://dev.opera.com/articles/view/mama/
-                Metadata Analysis and Mining Application
-
-* Validation.
-
-  http://validator.w3.org/
-
-* Add search to your site.
-
-  http://www.google.com/support/customsearch/
-                Custom Search Help
-  http://help.yahoo.com/l/uk/yahoo/search/basics/basics-13.html
-                Can I add a Yahoo! Search box to my site?
-