Benchmarking Bot Detection Systems Against Modern AI Agents in 2026
mdahardy
39 points
3 comments
October 20, 2026
Related Discussions
Found 5 related stories in 141.5ms across 10,084 title embeddings via pgvector HNSW
- Detecting and countering misuse of AI: September 2026 garo-pro · 110 pts · September 10, 2026 · 62% similar
- Show HN: Benchmark your eng team's AI agent maturity in 5 minutes adamgold7 · 13 pts · July 14, 2026 · 60% similar
- Hating AI in 2026 HotGarbage · 24 pts · July 14, 2026 · 59% similar
- Terminal-Bench-Science: Evaluating AI agents on scientific research workflows matt_d · 61 pts · August 28, 2026 · 57% similar
- Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot gavinhking · 261 pts · August 12, 2026 · 56% similar
Discussion Highlights (3 comments)
conception
Based on trying to buy anything retail that is scarce, bot detection systems are definitely not working. I wonder how their system would do against https://refractbot.com/ or other popular retail bots.
AznHisoka
Did they use the browsers against sites they owned or 3rd party ones? If the latter, then lots of sites have Cloudflare Bot Management on, without actual strict restrictions on bots (a lot of sites using CLoudflare as a CDN for instance)
vikrantrathore
In your bot detection systems I do not see open source system like anubis, safeline or sibuna (I am the author of sibuna). Sibuna is built as self-hosted alternative to cloudflare with console UI providing OWASP CRS, JA4 TLS signature from ingress, these are still necessary besides bot detection and cloudflare offer it as enterprise offering. I have a smaller benchmark for them in my book at https://insanai.github.io/sibuna/ . If you can provide your benchmarking code as open source will incorporate this report into sibuna book.