Duplicate page/url problem has been around for half a decade now. And still the confusion among site owners and webmasters float around. There is so many authentic and easy to understand articles on rel=”canonical” that it will be useless to talk about them all again. Rather I decided to put a reference of all such […]
Server Header Response Code (HTTP Status) Checking Tool
SEO Book Tool Bulk Page Header Check http://tools.seobook.com/server-header-checker/ Bulk Page Header Check http://tools.seobook.com/server-header-checker/?page=bulk&typeProtocol=11&useragent=1 httpstatus.io Tool Check status code, response headers, redirect location and redirect chain of a HTTP connection. Also export to CSV http://httpstatus.io/ web-sniffer.net Tool HTTP Web-Sniffer Online Tool http://web-sniffer.net/ HTTP Web-Sniffer Desktop App http://web-sniffer.net/app.html gidnetwork.com gzip-test http://www.gidnetwork.com/tools/gzip-test.php http://www.whatsmyip.org Tools HTTP Headers http://www.whatsmyip.org/http-response-headers/ HTTP […]
Robots Exclusion protocol (REP)
Robots Exclusion Protocol: now with even more flexibility “Details Last updated Februar 17, 2012. Webmasters — Google Developers Playing with the X-Robots-Tag HTTP header “Details On moz.com>learn>seo>robotstxt How to stop search engines from crawling the whole website? “Details Apache HTTP Server Version 2.2 httpd.apache.org>docs>2.2>mod Header set X-Robots-Tag “noindex, noarchive, nosnippet, nofollow, noimageindex, noodp” www.intelligentpositioning.com/blog/2009/08/x-robots-tag-control-google-indexing-via-http-headers/ http://noarchive.net/xrobots/