How Google Sees Your Site

ArcHound

I keep stumbling over different Google bots in my logs. So today I'm looking at each and every Googly eye that takes a look at my site. Because when you stare at me, I'll stare back. You have the right and the means to define what Google is allowed to do on your site, whether the Google traffic you face is extensive or you'd like to opt-out of AI training (check Google Other). Sadly, using robots.txt is not enough, Google admits that some of their bots will not respect the rules.