User-agent: * Disallow: /cgi-bin/ Disallow: /counter/ Disallow: /include/ Disallow: /paypal/ Disallow: /images/ Disallow: /exrate/ Crawl-delay: 3 User-agent: SemrushBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou web spider Crawl-Delay: 10 Sitemap: http://www.sellaite.com/sitemap.xml