Blocking Baidu and Yandex Search Spiders Implemented the following into the top of the HTACCESS file to have block the Baidu, Yandex and Sosospider bots from spidering website. “———————————————————————————– SetEnvIfNoCase User-agent “Baidu” spammer=yes SetEnvIfNoCase User-agent “Yandex” spammer=yes SetEnvIfNoCase User-agent “Sosospider” spammer=yes order deny,allow deny from env=spammer ————————————————————————————-” Source Robots.txt Specifications > Webmasters > Google Developers […]