User-agent: AhrefsBot Disallow: / User-agent: ia_archiver Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: * Disallow: /services/ Disallow: /global/ Disallow: /api/