Sites that block AI training crawlers mostly ignore the answer time bots

zeppelin_7 15 points 3 comments July 07, 2026
sitedex.dev · View on Hacker News

Discussion Highlights (2 comments)

maxutility

When the entire article reads like it’s written by an LLM —- ie the author couldn’t be bothered to write their thoughts out themselves —- it’s hard to give it the benefit of the doubt that it’s worth reading closely.

viccis

You would think that articles lamenting the vicissitudes of the AI's impact on the internet would avoid using very obvious AI copy, but I guess it's too tempting to just not do any work.

Semantic search powered by Rivestack pgvector
14,015 stories · 131,331 chunks indexed