web-seo.rst
author Oleksandr Gavenko <gavenkoa@gmail.com>
Sun, 07 Aug 2016 12:44:20 +0300
changeset 2009 33db8b550960
parent 2008 5919a8903b3f
child 2010 cd153030eca9
permissions -rw-r--r--
SERP structure
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
1334
9bf0d5a1f0cf Include common header with quick links.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1218
diff changeset
     1
.. -*- coding: utf-8; -*-
932
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     2
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     3
==========
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     4
 WEB SEO.
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     5
==========
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     6
.. contents::
1905
fba288d59662 Include only local subsections into TOC. This prevent duplication of
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1334
diff changeset
     7
   :local:
932
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     8
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
     9
General search engines
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    10
======================
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    11
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    12
Major search engines are:
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    13
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    14
* https://google.com from Google Co.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    15
* https://bing.com from Microsoft Co.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    16
* https://yahoo.com or https://search.yahoo.com/ from Yahoo Co and it uses Bing
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    17
  engine.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    18
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    19
Major local search engine are:
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    20
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    21
* https://yandex.com from Yandex Co that have large market on Russia, Ukraine, Belarus.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    22
2008
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    23
Search engine webmaster tools
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    24
=============================
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    25
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    26
https://www.google.com/webmasters/tools/home
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    27
  Google webmaster tools.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    28
https://www.bing.com/webmaster/
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    29
  Bind webmaster tools.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    30
https://webmaster.yandex.ru/
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    31
  Yandex webmaster tools.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    32
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    33
SEO tips
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    34
========
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    35
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    36
* Use pain text rather than images, CSS, JavaScript, Flash, SilverLite or other
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    37
  technologies for important content.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    38
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    39
* Make sure your site work without with CSS, JavaScript, Flash, Java, etc
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    40
  disabled. Check your site with screen reader or text browser (lynx, w3m).
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    41
2008
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    42
* Build valid HTML pages. Validate against W3C and other tools. Make site mobile
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    43
  friendly and use the mobile friendly test.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    44
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    45
* Avoid HTML frames and iframes.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    46
2008
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    47
* Market your site so other sites link to yours. The more valuable and relevant
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    48
  site point to you the more rank you get!
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    49
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    50
* Tend to focus on single topic per page.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    51
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    52
* Avoid cryptic URLs. Craft human attractive URLs as URL words directly can be
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    53
  indexed. Use dashes instead of spaces.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    54
2009
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    55
* Avoid duplication. Shutdown mirrors. Use ``<link rel="canonical" ...>`` tag to
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    56
  point to page on main version from mirrors or page variants. Avoid page
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    57
  variants (like embedding sid into URL). Use::
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    58
2009
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    59
    <link rel="prev" ...>
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    60
    <link rel="next" ...>
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    61
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    62
  to gather paginated content.
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    63
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    64
* Tags ``title``, ``h1`` / ``h2`` / ``h3`` and::
2008
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    65
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    66
    <meta name="description" content="...">
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    67
    <meta name="keywords" content="...">
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    68
2009
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    69
  have great impact. As usual make sure them have unique content across the web
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    70
  and your pages.
2008
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    71
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    72
* Add ``rel="nofollow"`` to spam or money making links.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    73
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    74
* Mark up site using microformats: ARIA, schema.org.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    75
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    76
* Submit sitemap to search engine webmaster tools.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    77
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    78
* Ensure a fast load time and absent of HTTP errors.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    79
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    80
* Make site sharable across social media.
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    81
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    82
https://support.google.com/webmasters/answer/40349
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    83
  Steps to a Google-friendly site.
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    84
https://support.google.com/webmasters/answer/139066
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    85
  Use canonical URLs
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    86
https://en.wikipedia.org/wiki/Canonical_link_element
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    87
  Wiki article.
2009
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    88
https://support.google.com/webmasters/answer/1663744
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    89
  Indicate paginated content.
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    90
https://support.google.com/webmasters/answer/76329
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    91
  Keep a simple URL structure.
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
    92
2008
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    93
http://webmasters.stackexchange.com/questions/22877/seo-where-do-i-start/
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    94
http://webmasters.stackexchange.com/questions/10281/seo-tips-and-tricks-for-web-developers
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    95
http://webmasters.stackexchange.com/questions/2/what-are-the-best-ways-to-increase-a-sites-position-in-google
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    96
http://webmasters.stackexchange.com/questions/237/basic-seo-optimization
5919a8903b3f Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2007
diff changeset
    97
2009
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    98
SERP structure
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
    99
==============
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   100
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   101
All popular search providers use ``title`` tag content as text for main link to
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   102
result entry and ``meta name="description"`` or relevant page piece for
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   103
description.
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   104
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   105
https://en.wikipedia.org/wiki/Search_engine_results_page
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   106
  Wikiperia article.
33db8b550960 SERP structure
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 2008
diff changeset
   107
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   108
Informing search engine about site structure
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   109
============================================
1217
3940dace0d88 Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1032
diff changeset
   110
::
3940dace0d88 Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1032
diff changeset
   111
3940dace0d88 Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1032
diff changeset
   112
  http://www.example.org/sitemap.xml
3940dace0d88 Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1032
diff changeset
   113
  http://www.example.org/robots.txt
3940dace0d88 Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1032
diff changeset
   114
2007
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   115
robots.txt
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   116
==========
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   117
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   118
Start line with ``#`` to commet it out.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   119
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   120
Disable all robots (that respect ``robots.txt``)::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   121
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   122
  User-agent: *
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   123
  Disallow: /
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   124
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   125
To allow all robots complete access::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   126
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   127
  User-agent: *
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   128
  Disallow:
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   129
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   130
To allow a single robot::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   131
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   132
  User-agent: Google
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   133
  Disallow:
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   134
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   135
  User-agent: *
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   136
  Disallow: /
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   137
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   138
All valuable search engines support ``Allow`` and ``Sitemap`` tags::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   139
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   140
  User-agent: *
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   141
  Allow: /
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   142
  Sitemap: http://example.com/sitemap1.xml
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   143
  Sitemap: http://example.com/my_sitemap2.xml
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   144
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   145
The longer path the higher priority of ``Allow`` and ``Disallow`` tags.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   146
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   147
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   148
http://www.robotstxt.org/orig.html
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   149
  Original specification. Only ``User-agent`` and ``Disallow`` tags supported.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   150
http://robotstxt.org.ru/
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   151
  Russian followup to http://www.robotstxt.org
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   152
https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   153
  Google extension specification.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   154
https://yandex.ru/support/webmaster/controlling-robot/robots-txt.xml
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   155
  Yandex extension specification.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   156
http://en.wikipedia.org/wiki/Robots.txt
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   157
  Wiki article.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   158
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   159
meta robots
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   160
===========
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   161
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   162
Instruction to not index current page::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   163
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   164
  <meta name="robots" content="noindex">
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   165
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   166
Instruction to not follow links on current page::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   167
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   168
  <meta name="robots" content="nofollow">
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   169
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   170
Pair combinations::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   171
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   172
  <meta name="robots" content="noindex, nofollow">
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   173
  <meta name="robots" content="noindex, follow">
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   174
  <meta name="robots" content="index, nofollow">
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   175
  <meta name="robots" content="index, follow">
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   176
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   177
rel nofollow attribute in link
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   178
==============================
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   179
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   180
To prevent spam on forums and blogs or to including commertial links::
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   181
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   182
  <a href="http://spam.com/sale/20-off" rel="nofollow">You win 100$!!</a>
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   183
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   184
https://support.google.com/webmasters/answer/96569
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   185
  Use rel="nofollow" for specific links.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   186
https://support.google.com/webmasters/answer/81749
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   187
  Ways to Prevent Comment Spam.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   188
https://en.wikipedia.org/wiki/Nofollow
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   189
  Wiki article.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   190
https://codex.wordpress.org/Nofollow
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   191
  Wordpress suggestions.
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   192
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   193
sitemap
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   194
=======
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   195
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   196
* http://en.wikipedia.org/wiki/Sitemaps
ebd98c98304b SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1923
diff changeset
   197
* http://www.sitemaps.org/
1217
3940dace0d88 Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 1032
diff changeset
   198
932
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   199
Alexa.
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   200
======
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   201
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   202
Statistics (most useful Top Search Queries):
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   203
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   204
  http://www.alexa.com/siteinfo/DOMAIN
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   205
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   206
Google.
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   207
=======
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   208
970
04ce91d377dd http://www.google.com/trends
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 956
diff changeset
   209
  http://www.google.com/trends
04ce91d377dd http://www.google.com/trends
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 956
diff changeset
   210
932
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   211
Yahoo.
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   212
======
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   213
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   214
Give backlink (this page redirect to siteexplorer.search.yahoo.com):
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   215
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   216
  linkdomain:DOMAIN -site:DOMAIN
b65ec623c6d1 WEB SEO.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
   217