User-agent: * Disallow: /Comments/ Disallow: /comments/ Crawl-delay: 8 User-agent: msnbot Crawl-delay: 10 User-agent: bingbot Crawl-delay: 10 user-agent: AhrefsBot disallow: / User-agent: Exabot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: CCBot Disallow: / User-agent: AlphaSeoBot Disallow: / User-agent: dotbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: ltx71 Disallow: / Sitemap: http://www.rabetpress.ir/sitemap.xml