User-agent: * Disallow: / # Admin Panel Assets Protection # This directory contains sensitive admin panel assets # Access is completely restricted for security purposes # Block all crawlers from accessing admin assets User-agent: Googlebot Disallow: / User-agent: Bingbot Disallow: / User-agent: Slurp Disallow: / User-agent: DuckDuckBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: YandexBot Disallow: / # Additional security measures User-agent: * Disallow: /admin_panel/ Disallow: /admin/ Disallow: /static/admin_panel/ # Crawl delay Crawl-delay: 86400