# Robots.txt for https://dewe.dev # Generated automatically User-agent: * Allow: / # Sitemap location Sitemap: https://dewe.dev/sitemap.xml # Block any future admin or private routes Disallow: /admin/ Disallow: /api/ Disallow: /.well-known/ # Allow all major search engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / # Crawl delay for politeness Crawl-delay: 1