• Home
  • SEM
    • PPC
    • SEO
    • How To
  • Bangladesh
  • School
    • HTTP
    • REP
    • Bots n’ htaccess
    • Source Code
    • Excel 2010
    • HTML XHTML Entities
    • Gmail Operators
    • HTML & ASCII
  • About
    • Privy
    • About This Blog
  • Contact
  • বাংলা

Saidul Hassan

Digital Marketing Evangelist

Home / School / Robots Exclusion protocol (REP)

Robots Exclusion protocol (REP)

28 Aug, 2013 By Saidul Hassan · Filed Under: School

Robots Exclusion Protocol: now with even more flexibility Details
Posted: Friday, July 27, 2007
Google Official Blog

Robots meta tag and X-Robots-Tag HTTP header specifications Details
Last updated Februar 17, 2012.
Webmasters — Google Developers

Playing with the X-Robots-Tag HTTP header Details
20 January, 2008 by Joost de Valk
yoast.com

What is Robots.txt? Details
On moz.com>learn>seo>robotstxt

How to stop search engines from crawling the whole website? Details
Feb 1 ’12 at 20:34
stackoverflow.com

Apache Module mod_headers Details
Apache HTTP Server Version 2.2
httpd.apache.org>docs>2.2>mod

Header set X-Robots-Tag "noindex, noarchive, nosnippet, nofollow, noimageindex, noodp"

www.intelligentpositioning.com/blog/2009/08/x-robots-tag-control-google-indexing-via-http-headers/
http://noarchive.net/xrobots/

The following two tabs change content below.
  • Bio
  • Latest Posts
My Twitter profileMy Facebook profileMy LinkedIn profileMy Instagram profileMy Pinterest profile

Saidul Hassan

Managing Partner at Up Arrow Consulting
COO at Up Arrow Consulting, MCC manager, & Technical SEO consultant. Certified Google Partners and Microsoft Bing Ads Accredited Professional, Python enthusiast, wannabe SysAdmin. Graduated from School of Management & Business Administration (SOMBA), Khulna University.
My Twitter profileMy Facebook profileMy LinkedIn profileMy Instagram profileMy Pinterest profile

Latest posts by Saidul Hassan (see all)

  • Batch script to create directories & moving fixed number of files to those directories - 30 Apr, 2021
  • How to use PrismJS syntax highlighter on WordPress without plugin - 30 Mar, 2020
  • Download an Entire Website for Offline Viewing - 26 Nov, 2019

Share:

  • Twitter
  • Facebook
  • LinkedIn
  • Pinterest
  • Pocket
  • Email
  • Print

First published on 28 Aug, 2013 · Last updated 28 Aug, 2013 · Tagged With: Apache Module, htaccess, HTTP Header, Meta robots, mod_headers, noarchive, nofollow, noimageindex, noindex, noodp, nosnippet, REP, Robots Exclusion Protocol, robots.txt, X-Robots-Tag

Batch script to create directories & moving fixed number of files to those directories

30 Apr, 2021 By Saidul Hassan

How to use PrismJS syntax highlighter on WordPress without plugin

30 Mar, 2020 By Saidul Hassan

Download an Entire Website for Offline Viewing

26 Nov, 2019 By Saidul Hassan

How to color highlight .htaccess files in Xed/Gedit

20 Aug, 2018 By Saidul Hassan

HMA Pro VPN Setup for Multiple Locations without User/Password Every time in Linux CLI

14 May, 2018 By Saidul Hassan

  • ♥ Bangladesh ♥
    Log in · Privacy Policy · Contact
    Copyright © 2011 Saidul Hassan

  • DMCA