# DJS Research - robots.txt (Production) User-agent: * Allow: / # Explicitly allow public assets Allow: /images/ Allow: /videos/ Allow: /static/ Allow: /docs/ Allow: /uploads/ # Private and non-public areas Disallow: /cp/ Disallow: /admin/ Disallow: /private/ Disallow: /temp/ Disallow: /cache/ Disallow: /writable/ Disallow: /app/ Disallow: /system/ Disallow: /vendor/ # Sitemaps Sitemap: https://djsresearch.co.uk/sitemap-index.xml Sitemap: https://djsresearch.co.uk/sitemap.xml Sitemap: https://djsresearch.co.uk/image-sitemap.xml Sitemap: https://djsresearch.co.uk/video-sitemap.xml