#disallow user agents User-agent: Wespe.de # Wespe.de robot - France User-agent: Yandex # Spider - Russian Search Engine User-agent: Sosospider # China Search Engine User-agent: moget #Japan User-agent: ichiro #Japan User-agent: NaverBot #Korea User-agent: Yeti #Korea User-agent: sogou spider #china User-agent: YoudaoBot #China User-agent: SeznamBot/3.0 #Czech Republic User-agent: AhrefsBot #Site scrapper from Ukraine User-agent: GrapeshotCrawler #UK User-agent: Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)#Site scraper User-agent: rogerbot User-agent: dotbot User-agent: mj12Bot #UK Disallow: / User-agent: * Disallow: */_layouts/*