User-agent: * Crawl-delay: 2 Disallow: /linguica/ Sitemap: https://www.doomworld.com/sitemap.php User-Agent: bingbot Crawl-delay: 20 # eat shit bingbots User-agent: AhrefsBot User-agent: MJ12bot User-agent: Yandex User-agent: Baiduspider Disallow: / User-agent: 360Spider Disallow: / User-agent: 8LEGS Disallow: / User-agent: A6-Indexer Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: betaBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: BoardReader Disallow: / User-agent: BPImageWalker Disallow: / User-agent: CheckMarkNetwork Disallow: / User-agent: Clockwork Data Vault Disallow: / User-agent: coccoc Disallow: / User-agent: CRAZYWEBCRAWLER Disallow: / User-agent : DAUM Disallow : / User-agent: Domain Re-Animator Disallow: / User-agent: DomainStatsBot Disallow: / User-agent: DotBot Disallow: / User-agent: EasouSpider Disallow: / # Ezooms and dotbot User-agent: Ezooms Disallow: / User-agent: Findxbot Disallow: / User-agent: GetIntent Disallow: / User-agent: Grammarly Disallow: / User-agent: grapeshot Disallow: / User-agent: Guardcrwlr Disallow: / User-agent: HubSpot Links Crawler Disallow: / User-agent: istellabot Disallow: / User-agent: KOCMOHABT Disallow: / User-agent: link checker Disallow: / User-agent: linkcheck Disallow: / User-agent: LinksCrawler Disallow: / User-agent: linkdexbot Disallow: / User-agent: Link Sleuth Disallow: / User-agent: LinkSpammer Disallow: / User-agent: LinkWalker Disallow: / User-agent: ltx71 Disallow: / User-agent: MauiBot Disallow: / User-agent: Mail.RU_Bot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: NetTrack Disallow: / User-agent: okhttp Disallow: / User-agent: OpenLinkProfiler Disallow: / User-Agent: PaperLiBot Disallow: / User-agent: Pingdom Disallow: / User-agent: proximic Disallow: / User-agent: Pu_iN Disallow: / User-agent: Pulsepoint Disallow: / User-agent: Qwantify Disallow: / User-agent: RankvalBot Disallow: / User-agent: SalesIntelligent Disallow: / User-agent: Scrapy Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: Searchie Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SocialRankIOBot Disallow: / User-agent: Sogou Disallow: / User-agent: Sogou web spider Disallow: / User-agent: spbot Disallow: / User-agent: SurveyBot Disallow: / User-agent: Uptimebot Disallow: / User-agent: Vegi bot Disallow: / Crawl-Delay: 20 # fuck off you stupid bot User-agent: VeriCiteCrawler Disallow: / User-agent: webmeup-crawler Disallow: / User-agent: weborama-fetcher Disallow: / User-agent: YisouSpider Disallow: / User-agent: YoudaoBot Disallow: / User-Agent: ZoomBot Disallow: /