# Used for many other (non-commercial) purposes as well User-agent: CCBot Disallow: / # For new training only User-agent: GPTBot Disallow: / # Not for training, only for user requests User-agent: ChatGPT-User Disallow: / # Marker for disabling Bard and Vertex AI User-agent: Google-Extended Disallow: / # Speech synthesis only? User-agent: FacebookBot Disallow: / # Multi-purpose, commercial uses; including LLMs User-agent: Omgilibot Disallow: / # Responsable de l'attaque du 19 avril 2024 User-agent: ClaudeBot Disallow: / # Responsables de l'attaque du 9-10 juillet 2025 User-agent: ByteDanceSpider Disallow: / User-agent: Bytespider Disallow: / User-agent: Qwantify Disallow: / User-agent: PetalBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AhrefsSiteAudit Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: barkrowler Disallow: / User-agent: * Disallow: /?s=* Disallow: /search/* Crawl-delay: 15