# robots.txt for https://reliablerealtydr.com/ # Reliable Realty SRL - real estate sales, property management, project management # and expat services in Bavaro, Punta Cana, Dominican Republic (since 2008). # Last updated: 2026-10-26 # # Crawl policy: all public pages, property listings and images are open to every # search engine and AI crawler. Only the admin area, internal property-search result # URLs, the debug-toolbar URLs and Cloudflare's email-protection links are blocked. # Note: a crawler that matches a named group ignores the "*" group, so each named # group below repeats the same rules on purpose. # Default group - all other crawlers User-agent: * Allow: /public/ Allow: /images/ Disallow: /admin/ Disallow: /search Disallow: /*?debugbar Disallow: /cdn-cgi/l/ # Search engines User-agent: Googlebot User-agent: Googlebot-Image User-agent: Bingbot User-agent: Slurp User-agent: DuckDuckBot User-agent: Applebot User-agent: YandexBot Allow: /public/ Allow: /images/ Disallow: /admin/ Disallow: /search Disallow: /*?debugbar Disallow: /cdn-cgi/l/ # AI search and assistant crawlers (answer engines, live user fetches) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: DuckAssistBot User-agent: MistralAI-User Allow: /public/ Allow: /images/ Disallow: /admin/ Disallow: /search Disallow: /*?debugbar Disallow: /cdn-cgi/l/ # AI model crawlers (allowed by default; blocking these is the client's decision) User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Amazonbot User-agent: Meta-ExternalAgent User-agent: CCBot Allow: /public/ Allow: /images/ Disallow: /admin/ Disallow: /search Disallow: /*?debugbar Disallow: /cdn-cgi/l/ # Sitemap Sitemap: https://reliablerealtydr.com/sitemap.xml # AI-readable site summary: https://reliablerealtydr.com/llms.txt