User-agent: * Crawl-delay: 5 # Block search URLs with any parameters (allows root URLs by default) Disallow: /awards/search? Disallow: /projects/search? Disallow: /search? User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: /