User-agent: Gigabot Disallow: / User-agent: Yandex Disallow: / User-agent: Nutch Disallow: / User-agent: naverbot Disallow: / User-agent: yeti Disallow: / User-agent: yahoo-mmcrawler Disallow: / User-agent: psbot Disallow: / User-agent: * Disallow: Crawl-delay: 10 Disallow: /cgi-bin/ Disallow: /private_html/ Disallow: /admin/admin.php Sitemap: https://goblacked.com/sitemap_index.xml Sitemap: https://goblacked.com/sitemap.xml