equal
deleted
inserted
replaced
47 http://www.robotstxt.org/faq.html |
47 http://www.robotstxt.org/faq.html |
48 Frequently Asked Questions |
48 Frequently Asked Questions |
49 http://googlewebmastercentral.blogspot.com/2008/06/improving-on-robots-exclusion-protocol.html |
49 http://googlewebmastercentral.blogspot.com/2008/06/improving-on-robots-exclusion-protocol.html |
50 Improving on Robots Exclusion Protocol |
50 Improving on Robots Exclusion Protocol |
51 |
51 |
|
52 Sitemap. |
|
53 ======== |
|
54 |
|
55 Sitemaps protocol allows a webmaster to inform search engines about URLs on a |
|
56 website that are available for crawling. |
|
57 |
|
58 http://www.sitemaps.org/protocol.html |
|
59 Sitemap protocol. |
|
60 http://en.wikipedia.org/wiki/Sitemaps |
|
61 Wikipedia article. |
|
62 |
52 Web document structure useage. |
63 Web document structure useage. |
53 ============================== |
64 ============================== |
54 |
65 |
55 http://dev.opera.com/articles/view/mama/ |
66 http://dev.opera.com/articles/view/mama/ |
56 Metadata Analysis and Mining Application |
67 Metadata Analysis and Mining Application |