User-agent: * # /login, /register, /reset-password, /checkout, /dashboard and /auth are # intentionally left crawlable (not Disallow'd) — they carry a noindex # directive instead (X-Robots-Tag header for /dashboard and /auth, set in # middleware.ts; page-level meta tag for /login etc.), so Google can actually # crawl them, read the noindex directive, and drop them from the index. # Blocking them here would hide that directive and leave any already-indexed # URL stuck showing generic boilerplate forever. Disallow: /account/ Disallow: /profile/ Disallow: /settings/ Disallow: /app/ Disallow: /admin/ Disallow: /api/ Disallow: /callback/ Disallow: /search Disallow: /*?search= Disallow: /*?query= Disallow: /*?page= Allow: /_next/static/ Allow: /_next/image/ # XML Sitemap Sitemap: https://xelta.ai/sitemap.xml Sitemap: https://xelta.ai/sitemap-pages.xml Sitemap: https://xelta.ai/sitemap-tools.xml Sitemap: https://xelta.ai/sitemap-ai-studio.xml Sitemap: https://xelta.ai/sitemap-ai-film.xml Sitemap: https://xelta.ai/sitemap-ai-ads.xml Sitemap: https://xelta.ai/sitemap-models.xml Sitemap: https://xelta.ai/sitemap-blogs.xml Sitemap: https://xelta.ai/sitemap-events.xml Sitemap: https://xelta.ai/sitemap-landing.xml Sitemap: https://xelta.ai/sitemap-0.xml