User-agent: * Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / # AI / search crawlers: allow indexing of public pages User-agent: GPTBot Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: OAI-SearchBot Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: ChatGPT-User Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: ClaudeBot Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: PerplexityBot Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: Google-Extended Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: CCBot Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: Bingbot Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: Applebot-Extended Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / User-agent: anthropic-ai Disallow: /auth/ Disallow: /messages Disallow: /inbox Disallow: /notifications Disallow: /settings Disallow: /coins Disallow: /manage Disallow: /dashboard Disallow: /verify-mobile Disallow: /verify-email Disallow: /reset-password Disallow: /superadmin/ Allow: / # Sitemaps — single sitemap index (it references every child sitemap: static, # pages, learn, blog, article, user, service, video, and paginated jobs). # Declaring only the index avoids the "index + children" redundancy and keeps # one source of truth for crawlers. Sitemap: https://www.palify.io/sitemap.xml # LLMs # LLM context: https://www.palify.io/llms.txt