Sites that block AI training crawlers mostly ignore the answer time bots
zeppelin_7
15 points
3 comments
July 07, 2026
Related Discussions
Found 5 related stories in 844.0ms across 14,015 title embeddings via pgvector HNSW
- CAPTCHAs can still detect AI agents timshell · 73 pts · May 29, 2026 · 54% similar
- Number of AI chatbots ignoring human instructions increasing, study says c420 · 14 pts · March 27, 2026 · 51% similar
- Show HN: Free tool to see how much AI bots are costing your site plaintosapp · 18 pts · May 11, 2026 · 51% similar
- Blocking Internet Archive Won't Stop AI, but Will Erase Web's Historical Record pabs3 · 507 pts · March 21, 2026 · 49% similar
- Google's AI Overviews spew false answers per hour, bombshell study reveals 1vuio0pswjnm7 · 18 pts · April 10, 2026 · 49% similar
Discussion Highlights (2 comments)
maxutility
When the entire article reads like it’s written by an LLM —- ie the author couldn’t be bothered to write their thoughts out themselves —- it’s hard to give it the benefit of the doubt that it’s worth reading closely.
viccis
You would think that articles lamenting the vicissitudes of the AI's impact on the internet would avoid using very obvious AI copy, but I guess it's too tempting to just not do any work.