User-agent: Twiceler User-agent: pompos User-agent: semanticdiscovery User-agent: Gaisbot User-agent: QihooBot User-agent: Gigabot User-agent: ShopWiki User-agent: NGBot/4.5 User-agent: Sosoimagespider User-agent: VoilaBot User-agent: HTTrack User-agent: HTTrack 3.0 User-agent: WinHTTrack User-agent: voyager User-agent: DotBot User-agent: TurnitinBot User-agent: TurnitinBot/2.1 Disallow: / User-agent: Slurp User-agent: msnbot User-agent: Teoma Crawl-delay: 20 User-agent: CCBot/1.0 User-agent: Speedy User-agent: MJ12bot User-agent: WebAlta Crawler/2.0 User-agent: boitho.com-dc User-agent: FatBot User-agent: discobot User-agent: Sosospider User-agent: Baiduspider User-agent: MLBot User-agent: bot/1.0 User-agent: CazoodleBot User-agent: Exabot User-agent: Exabot-Thumbnails User-agent: ia_archiver User-agent: seekbot User-agent: BecomeBot User-agent: asterias User-agent: Snapbot User-agent: ichiro User-agent: IRLbot User-agent: SearchDaimon.com-dc User-agent: Yanga WorldSearch Bot User-agent: SapphireWebCrawler/1.0 User-agent: Yandex Disallow: /liste/ Crawl-delay: 20 User-agent: * Disallow: /admin/ Disallow: /CFIDE/ Disallow: /caddie/ Disallow: /commande/ Disallow: /gestion/ Disallow: /moteur_de_rech/ Disallow: /enregistrement/ Disallow: /nolink.cfm Disallow: /nolink_trap.cfm Disallow: /login/