April 2025 list of AI user-agents, with practical robots.txt and auditing tips. LLM/AI crawlers leave their signatures through a user-agent string. I monitor those strings so I can welcome the bots that help me to build my audience and politely ask the ones that don't to leave. Now you can too.
