I’ve Been Deindexed by Google

I’ve Been Deindexed by Google! 07 Oct, 2026 I don’t remember exactly when but, earlier in the year, I decided I didn’t want this website to be indexed by search engines anymore. A lot of it has to do with AI and the relentless scraping that plagues the internet now.

我被谷歌取消索引了！2026年10月7日。我不记得具体是什么时候了，但在今年早些时候，我决定不再让这个网站被搜索引擎索引。这很大程度上与人工智能以及现在困扰互联网的无休止的数据抓取有关。

I know that as long as my blog is accessible by the public internet, there are no real measures I can put in to stop it but at least some of it will be respected. I started out by setting a blanket disallow in the robots.txt. User-agent: * Disallow: /

我知道，只要我的博客在公共互联网上可以访问，我就没有真正的办法来阻止它，但至少其中一些（抓取行为）会受到尊重。我最初是在 robots.txt 中设置了全面禁止。User-agent: * Disallow: /

When I realised that didn’t do anything after a few weeks of waiting and checking, I set the robots meta tag. I thought that would do the trick.

当我在等待和检查了几周后意识到这样做没有任何作用时，我设置了 robots 元标签。 我以为这样就能奏效。

What I didn’t realise is that you have to actually, ironically, allow the bot that will do the deindexing to visit your website so that it can see the meta tag that tells it to not index your page anymore. User-agent: Googlebot Allow: / User-agent: * Disallow: /

我没有意识到的是，讽刺的是，你必须允许执行取消索引操作的机器人访问你的网站，这样它才能看到那个告诉它不要再索引你的页面的元标签。User-agent: Googlebot Allow: / User-agent: * Disallow: /

I also did this with several other common bots and removed them from the robots.txt whenever I found that my website had been deindexed. It’s been at least 3 months since I did my last change to have Google deindex me and, after checking today, I’m happy to announce that this website is free from Google! 🥳 #degoogle #meta

我也对其他几个常见的机器人做了同样的处理，每当我发现我的网站被取消索引后，就会把它们从 robots.txt 中移除。距离我最后一次为了让谷歌取消索引而做出更改已经至少 3 个月了，今天检查后，我很高兴地宣布，这个网站已经摆脱了谷歌！🥳 #degoogle #meta