Same model, same Q4_K_M label: 5.02, 5.07 and 5.27 bits per weight

logickkk1 13 points 2 comments July 14, 2026
github.com · View on Hacker News

Discussion Highlights (1 comments)

p_stuart82

Does this catch intermittent fallback between requests?

Semantic search powered by Rivestack pgvector
5,215 stories · 47,053 chunks indexed