User-agent: MSIECrawler
User-agent: HTTrack
User-agent: SemrushBot
User-agent: BLEXBot
Disallow: /

User-agent: bingbot
Crawl-delay: 10


User-agent: *
Disallow: /datenschutz.php

Sitemap: https://www.computerlexikon.com/GoogleSitemap.xml.gz