Run QWEN3.8 27B on 16gb Nvidia GPUs
Pragmata
16 points
4 comments
September 17, 2026
Related Discussions
Found 5 related stories in 126.4ms across 11,510 title embeddings via pgvector HNSW
- Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU pich · 37 pts · August 17, 2026 · 72% similar
- Qwen 3.8 Max linzhangrun · 26 pts · July 19, 2026 · 71% similar
- Running Qwen3.8-Flash-Next NVFP4 at 184 tok/s on a single RTX 6000 Pro matteohorvath · 14 pts · October 26, 2026 · 69% similar
- Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s snehesht · 696 pts · October 04, 2026 · 69% similar
- Qwen3.8-Max Bluestein · 25 pts · September 02, 2026 · 68% similar
Discussion Highlights (1 comments)
Pragmata
I've been using it for the past few days, and it runs really well! I usually get 7 token/s using llama or lm studio, but this inference recipe runs at a smooth 80 tokens per second. Genuinely very usable, and fully local!