# ===== OPENAI ===== User-agent: GPTBot Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ User-agent: OAI-SearchBot Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ # ChatGPT-User is not a crawler, just used when a user clicks a link User-agent: ChatGPT-User Allow: / # ===== ANTHROPIC (Claude) ===== User-agent: AnthropicBot Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ # ===== PERPLEXITY AI ===== User-agent: PerplexityBot Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ # ===== COMMON CRAWL (used by LLMs) ===== User-agent: CCBot Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ # ===== GOOGLE ===== User-agent: Googlebot Allow: / User-agent: Google-Extended Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ # ===== BING / MICROSOFT ===== User-agent: bingbot Allow: / User-agent: BingPreview Allow: / # ===== AMAZON AI ===== User-agent: Amazonbot Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ # ===== META / FACEBOOK ===== User-agent: facebot Allow: / User-agent: facebookexternalhit Allow: / # ===== ALL OTHER BOTS ===== User-agent: * Allow: / Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.webp$ Disallow: /*.svg$ Sitemap: https://www.signdocs.com.br/sitemap.xml