# robots.txt for A Chave - https://www.achave.cv/ # Allow all major search engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: YandexBot Allow: / # Social media crawlers User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / # Default rule for all other bots User-agent: * Allow: / # Block access to admin and private areas Disallow: /admin Disallow: /candidato Disallow: /parceiro # Block API endpoints Disallow: /api/ # Crawl delay to be nice to the server Crawl-delay: 1 # Sitemap location Sitemap: https://www.achave.cv/sitemap.xml