User-agent: * Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /deal-analyzer/exceeded/ Disallow: /deal-analyzer/expired/ Disallow: /rent-estimator/exceeded/ Disallow: /rent-estimator/expired/ Disallow: /crime-map/exceeded/ Disallow: /crime-map/expired/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ # AI Search Crawlers — explicitly allowed for AI search visibility User-agent: GPTBot Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: OAI-SearchBot Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: ChatGPT-User Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: PerplexityBot Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: ClaudeBot Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: Google-Extended Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: Bytespider Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ User-agent: CCBot Allow: / Disallow: /dashboard/ Disallow: /api/ Disallow: /uploads/ Disallow: /registered-offenders/ Disallow: /sex-offenders/ Disallow: /subscribe/ Sitemap: https://www.doorprofit.com/sitemaps/sitemap-index.xml