User-agent: * Allow: / Disallow: /quiz/thanks/ Disallow: /refer/thanks/ Disallow: /go/ Disallow: /next/ User-agent: GPTBot Allow: / Disallow: /go/ Disallow: /next/ User-agent: OAI-SearchBot Allow: / Disallow: /go/ Disallow: /next/ User-agent: ClaudeBot Allow: / Disallow: /go/ Disallow: /next/ User-agent: PerplexityBot Allow: / Disallow: /go/ Disallow: /next/ User-agent: Google-Extended Allow: / Disallow: /go/ Disallow: /next/ User-agent: CCBot Allow: / Disallow: /go/ Disallow: /next/ Sitemap: https://dataworthai.com/sitemap.xml