技术博客 Wandering Thoughts 因 LLM 爬虫滥用全面封禁 AI 智能体

One reason for you to see this is that your User-Agent appears in ai.robots.txt. Due to extensive abuses by LLM crawlers, Wandering Thoughts, my techblog, is no longer available to such agents or anything that is too much like them.

If this is in error, you can contact the operator of the above Github repository to get your User-Agent exempted and then wait for me to pull an update. I am probably not interested in specifically exempting your User-Agent, but if you must, you can contact me at my current place at the university (you should be able to work out the email address from that).

Another reason for you to see this is that you are using (or are) an AI agent that is attempting to fetch content. I block all AI agents, whether or not there is a human being behind them, for an assortment of reasons, including that AI agents are the product of an extremely abusive process (see 'extensive abuses by LLM crawlers'). There is no ethical use of AI agents and I am not interested in helping people who do not care about the ethics of the tools they use.

If you are not actually using an AI agent and my User-Agent matching has mis-identified what you are using, you can get in touch with me, with the specific User-Agent of your program. See also my page on excessively generic User-Agent headers.

Chris Siebenmann, 2026-02-13