author | Oleksandr Gavenko <gavenkoa@gmail.com> |
Mon, 23 Nov 2020 00:32:17 +0200 | |
changeset 2468 | cab0464c11f4 |
parent 2444 | 5b0a1a654b43 |
permissions | -rw-r--r-- |
1334
9bf0d5a1f0cf
Include common header with quick links.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1218
diff
changeset
|
1 |
.. -*- coding: utf-8; -*- |
932 | 2 |
|
2010 | 3 |
====================================== |
4 |
WEB SEO (search engine optimisation) |
|
5 |
====================================== |
|
932 | 6 |
.. contents:: |
1905
fba288d59662
Include only local subsections into TOC. This prevent duplication of
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1334
diff
changeset
|
7 |
:local: |
932 | 8 |
|
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
9 |
General search engines |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
10 |
====================== |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
11 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
12 |
Major search engines are: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
13 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
14 |
* https://google.com from Google Co. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
15 |
* https://bing.com from Microsoft Co. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
16 |
* https://yahoo.com or https://search.yahoo.com/ from Yahoo Co and it uses Bing |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
17 |
engine. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
18 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
19 |
Major local search engine are: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
20 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
21 |
* https://yandex.com from Yandex Co that have large market on Russia, Ukraine, Belarus. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
22 |
|
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
23 |
Search engine webmaster tools |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
24 |
============================= |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
25 |
|
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
26 |
https://www.google.com/webmasters/tools/home |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
27 |
Google webmaster tools. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
28 |
https://www.bing.com/webmaster/ |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
29 |
Bind webmaster tools. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
30 |
https://webmaster.yandex.ru/ |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
31 |
Yandex webmaster tools. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
32 |
|
2444 | 33 |
Backlinks |
34 |
========= |
|
35 |
||
36 |
To find backlinks to your site/page use: |
|
37 |
||
38 |
https://ahrefs.com/backlink-checker |
|
39 |
Free version of Ahrefs' Backlink Checker. |
|
40 |
https://www.bing.com/webmasters/backlinks |
|
41 |
Google Search console "Links report". |
|
42 |
https://support.google.com/webmasters/answer/9049606 |
|
43 |
Docs on Google Search console "Links report". |
|
44 |
https://www.bing.com/webmasters/backlinks |
|
45 |
Bing Webmaster SEO tools: Backlinks. |
|
46 |
||
47 |
Some others: |
|
48 |
||
49 |
https://app.neilpatel.com/en/seo_analyzer/backlinks |
|
50 |
Backlinks. |
|
51 |
||
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
52 |
SEO tips |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
53 |
======== |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
54 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
55 |
* Use pain text rather than images, CSS, JavaScript, Flash, SilverLite or other |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
56 |
technologies for important content. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
57 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
58 |
* Make sure your site work without with CSS, JavaScript, Flash, Java, etc |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
59 |
disabled. Check your site with screen reader or text browser (lynx, w3m). |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
60 |
|
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
61 |
* Build valid HTML pages. Validate against W3C and other tools. Make site mobile |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
62 |
friendly and use the mobile friendly test. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
63 |
|
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
64 |
* Avoid HTML frames and iframes. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
65 |
|
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
66 |
* Market your site so other sites link to yours. The more valuable and relevant |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
67 |
site point to you the more rank you get! |
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
68 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
69 |
* Tend to focus on single topic per page. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
70 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
71 |
* Avoid cryptic URLs. Craft human attractive URLs as URL words directly can be |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
72 |
indexed. Use dashes instead of spaces. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
73 |
|
2009 | 74 |
* Avoid duplication. Shutdown mirrors. Use ``<link rel="canonical" ...>`` tag to |
75 |
point to page on main version from mirrors or page variants. Avoid page |
|
76 |
variants (like embedding sid into URL). Use:: |
|
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
77 |
|
2009 | 78 |
<link rel="prev" ...> |
79 |
<link rel="next" ...> |
|
80 |
||
81 |
to gather paginated content. |
|
82 |
||
83 |
* Tags ``title``, ``h1`` / ``h2`` / ``h3`` and:: |
|
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
84 |
|
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
85 |
<meta name="description" content="..."> |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
86 |
<meta name="keywords" content="..."> |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
87 |
|
2009 | 88 |
have great impact. As usual make sure them have unique content across the web |
89 |
and your pages. |
|
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
90 |
|
2010 | 91 |
* Use keywrds for internal ``a`` links. |
92 |
||
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
93 |
* Add ``rel="nofollow"`` to spam or money making links. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
94 |
|
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
95 |
* Mark up site using microformats: ARIA, schema.org. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
96 |
|
2010 | 97 |
* Keep navigational structure (global and hierarchical) easy to crawl. |
98 |
||
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
99 |
* Submit sitemap to search engine webmaster tools. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
100 |
|
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
101 |
* Ensure a fast load time and absent of HTTP errors. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
102 |
|
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
103 |
* Make site sharable across social media. |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
104 |
|
2010 | 105 |
* Use redirects when changes site structure. This usually move page value to new |
106 |
page. |
|
107 |
||
108 |
* Produce new content frequently. That make crawlers visit your site more |
|
109 |
frequently. |
|
110 |
||
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
111 |
https://support.google.com/webmasters/answer/40349 |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
112 |
Steps to a Google-friendly site. |
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
113 |
https://support.google.com/webmasters/answer/139066 |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
114 |
Use canonical URLs |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
115 |
https://en.wikipedia.org/wiki/Canonical_link_element |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
116 |
Wiki article. |
2009 | 117 |
https://support.google.com/webmasters/answer/1663744 |
118 |
Indicate paginated content. |
|
119 |
https://support.google.com/webmasters/answer/76329 |
|
120 |
Keep a simple URL structure. |
|
2010 | 121 |
https://www.bing.com/webmaster/help/webmaster-guidelines-30fba23a |
122 |
Bing Webmaster Guidelines. |
|
123 |
https://yandex.ru/support/webmaster/recommendations/intro.xml |
|
124 |
Рекомендации по созданию сайтов от Yandex. |
|
125 |
https://support.google.com/webmasters/answer/35769 |
|
126 |
Google Webmaster Guidelines. |
|
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
127 |
|
2008
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
128 |
http://webmasters.stackexchange.com/questions/22877/seo-where-do-i-start/ |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
129 |
http://webmasters.stackexchange.com/questions/10281/seo-tips-and-tricks-for-web-developers |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
130 |
http://webmasters.stackexchange.com/questions/2/what-are-the-best-ways-to-increase-a-sites-position-in-google |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
131 |
http://webmasters.stackexchange.com/questions/237/basic-seo-optimization |
5919a8903b3f
Search engine webmaster tools.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2007
diff
changeset
|
132 |
|
2009 | 133 |
SERP structure |
134 |
============== |
|
135 |
||
136 |
All popular search providers use ``title`` tag content as text for main link to |
|
137 |
result entry and ``meta name="description"`` or relevant page piece for |
|
138 |
description. |
|
139 |
||
2010 | 140 |
Also ``title`` is used in browser window title bar and as bookmark title. |
141 |
||
2009 | 142 |
https://en.wikipedia.org/wiki/Search_engine_results_page |
143 |
Wikiperia article. |
|
2010 | 144 |
https://www.w3.org/QA/Tips/good-titles.html |
145 |
<title>: the most important element of a quality Web page. |
|
146 |
https://www.w3.org/QA/Tips/Use_h1_for_Title |
|
147 |
Use <h1> for top-level heading. |
|
2009 | 148 |
|
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
149 |
Informing search engine about site structure |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
150 |
============================================ |
1217
3940dace0d88
Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1032
diff
changeset
|
151 |
:: |
3940dace0d88
Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1032
diff
changeset
|
152 |
|
3940dace0d88
Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1032
diff
changeset
|
153 |
http://www.example.org/sitemap.xml |
3940dace0d88
Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1032
diff
changeset
|
154 |
http://www.example.org/robots.txt |
3940dace0d88
Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1032
diff
changeset
|
155 |
|
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
156 |
robots.txt |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
157 |
========== |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
158 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
159 |
Start line with ``#`` to commet it out. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
160 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
161 |
Disable all robots (that respect ``robots.txt``):: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
162 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
163 |
User-agent: * |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
164 |
Disallow: / |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
165 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
166 |
To allow all robots complete access:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
167 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
168 |
User-agent: * |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
169 |
Disallow: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
170 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
171 |
To allow a single robot:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
172 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
173 |
User-agent: Google |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
174 |
Disallow: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
175 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
176 |
User-agent: * |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
177 |
Disallow: / |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
178 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
179 |
All valuable search engines support ``Allow`` and ``Sitemap`` tags:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
180 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
181 |
User-agent: * |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
182 |
Allow: / |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
183 |
Sitemap: http://example.com/sitemap1.xml |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
184 |
Sitemap: http://example.com/my_sitemap2.xml |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
185 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
186 |
The longer path the higher priority of ``Allow`` and ``Disallow`` tags. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
187 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
188 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
189 |
http://www.robotstxt.org/orig.html |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
190 |
Original specification. Only ``User-agent`` and ``Disallow`` tags supported. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
191 |
http://robotstxt.org.ru/ |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
192 |
Russian followup to http://www.robotstxt.org |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
193 |
https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
194 |
Google extension specification. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
195 |
https://yandex.ru/support/webmaster/controlling-robot/robots-txt.xml |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
196 |
Yandex extension specification. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
197 |
http://en.wikipedia.org/wiki/Robots.txt |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
198 |
Wiki article. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
199 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
200 |
meta robots |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
201 |
=========== |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
202 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
203 |
Instruction to not index current page:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
204 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
205 |
<meta name="robots" content="noindex"> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
206 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
207 |
Instruction to not follow links on current page:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
208 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
209 |
<meta name="robots" content="nofollow"> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
210 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
211 |
Pair combinations:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
212 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
213 |
<meta name="robots" content="noindex, nofollow"> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
214 |
<meta name="robots" content="noindex, follow"> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
215 |
<meta name="robots" content="index, nofollow"> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
216 |
<meta name="robots" content="index, follow"> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
217 |
|
2106 | 218 |
https://support.google.com/webmasters/answer/93710 |
219 |
Block search indexing with meta tags. |
|
220 |
http://www.robotstxt.org/meta.html |
|
221 |
About the Robots ``<META>`` tag. |
|
222 |
https://en.wikipedia.org/wiki/Noindex |
|
223 |
Wikiperia article. |
|
224 |
||
2007
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
225 |
rel nofollow attribute in link |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
226 |
============================== |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
227 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
228 |
To prevent spam on forums and blogs or to including commertial links:: |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
229 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
230 |
<a href="http://spam.com/sale/20-off" rel="nofollow">You win 100$!!</a> |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
231 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
232 |
https://support.google.com/webmasters/answer/96569 |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
233 |
Use rel="nofollow" for specific links. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
234 |
https://support.google.com/webmasters/answer/81749 |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
235 |
Ways to Prevent Comment Spam. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
236 |
https://en.wikipedia.org/wiki/Nofollow |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
237 |
Wiki article. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
238 |
https://codex.wordpress.org/Nofollow |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
239 |
Wordpress suggestions. |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
240 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
241 |
sitemap |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
242 |
======= |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
243 |
|
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
244 |
* http://en.wikipedia.org/wiki/Sitemaps |
ebd98c98304b
SEO tips. robots.txt. rel nofollow attribute in link.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1923
diff
changeset
|
245 |
* http://www.sitemaps.org/ |
1217
3940dace0d88
Informing search engine about site structure.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
1032
diff
changeset
|
246 |
|
932 | 247 |
Alexa. |
248 |
====== |
|
249 |
||
2228
837f1337c59b
Removed indentation that compiled into <blockquote>.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2106
diff
changeset
|
250 |
Statistics (most useful Top Search Queries):: |
932 | 251 |
|
252 |
http://www.alexa.com/siteinfo/DOMAIN |
|
253 |
||
254 |
Google. |
|
255 |
======= |
|
256 |
||
2228
837f1337c59b
Removed indentation that compiled into <blockquote>.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2106
diff
changeset
|
257 |
* http://www.google.com/trends |
970
04ce91d377dd
http://www.google.com/trends
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
956
diff
changeset
|
258 |
|
932 | 259 |
Yahoo. |
260 |
====== |
|
261 |
||
2228
837f1337c59b
Removed indentation that compiled into <blockquote>.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
2106
diff
changeset
|
262 |
Give backlink (this page redirect to siteexplorer.search.yahoo.com):: |
932 | 263 |
|
264 |
linkdomain:DOMAIN -site:DOMAIN |
|
265 |