# Keep this prefix without a trailing slash or end anchor: it covers the listing, # detail pages, direct .html files, __data.json responses and query variants. # Specific bot groups must repeat it; they do not inherit the wildcard group. # Weakening this protection requires explicit user approval (CLAUDE.md). User-agent: * Disallow: /ny/coa/methodology/full-data-report Allow: / User-agent: OAI-SearchBot Disallow: /ny/coa/methodology/full-data-report Allow: / User-agent: Claude-SearchBot Disallow: /ny/coa/methodology/full-data-report Allow: / User-agent: Claude-User Disallow: /ny/coa/methodology/full-data-report Allow: / User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / Sitemap: https://www.scrutinize.org/sitemap.xml