# Amateur Voltaire — robots.txt (audit 2026-09-19, S-1 / decision D4) # Search engines and the AI answer engines that cite and link back are welcome; # bots that only collect training data are not. Bytespider ignores this file, # so it is also refused at the server (.htaccess). User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /?s= Disallow: /search/ # Training-only crawlers User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://www.amateurvoltaire.com/wp-sitemap.xml