# GarSan Plumbing Services LLC User-agent: * Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ # --------------------------------------------------------------------------- # AI / answer-engine crawlers, explicitly allowed. # # ⚠️ CLOUDFLARE GOTCHA, READ BEFORE DEBUGGING THIS FILE: # Cloudflare can INJECT its own managed robots.txt at the edge that sets `Disallow: /` # for GPTBot, ClaudeBot, CCBot, Google-Extended and others, directly contradicting the # Allow rules below. The origin file looks fine while the SERVED file blocks everything. # Fix: Cloudflare dashboard, zone, AI Crawl Control, "Manage your robots.txt", # set to "Disable robots.txt configuration". # Always check the Allow/Disallow directive UNDER each user-agent, not just that the # user-agent line is present. That mistake hid this problem on a previous build. # --------------------------------------------------------------------------- User-agent: GPTBot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: OAI-SearchBot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: ChatGPT-User Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: PerplexityBot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Perplexity-User Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: ClaudeBot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Claude-Web Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Google-Extended Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Applebot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Applebot-Extended Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Amazonbot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: CCBot Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: cohere-ai Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ User-agent: Meta-ExternalAgent Allow: / Disallow: /leads/ Disallow: /products/ Disallow: /wp- Disallow: /*?products/ # Curated summaries for AI answer engines. Both are generated at build time from the same # data that drives the site, so they cannot drift from it. # AI crawlers discover these at their standard locations. Kept as comments: "LLM-Content:" # is not a robots.txt directive and made validators flag the whole file (Semrush, 2026-09-26). # llms.txt: https://garsanplumbingservices.com/llms.txt # llms-full.txt: https://garsanplumbingservices.com/llms-full.txt Sitemap: https://garsanplumbingservices.com/sitemap-index.xml