We fine-tuned a 235B model on 4 GPUs. Then we didn't need it
kgritesh
12 points
2 comments
October 19, 2026
Related Discussions
Found 5 related stories in 110.0ms across 9,963 title embeddings via pgvector HNSW
- Benchmarking 15 “E-Waste” GPUs with Modern Workloads eso_logic · 123 pts · July 13, 2026 · 53% similar
- Hetzner: The New GPU Server GEX63 for Professional AI Workloads tosh · 14 pts · October 12, 2026 · 49% similar
- Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU pich · 37 pts · August 17, 2026 · 49% similar
- A $500 RL fine-tune of a 9B open model beat frontier models on catalog review ilreb · 98 pts · July 28, 2026 · 48% similar
- Detecting model weight tampering in GPU memory (Rome attacks) rafaeldavidtin · 18 pts · October 19, 2026 · 48% similar
Discussion Highlights (2 comments)
greazy
I really enjoyed this blog, well written and takes the time to describe technical aspects of LLMs that I wasn't familiar with (noob here).
rurban
We still fine-tune, because our problems aren't covered by existing models, proprietary tagged images. But not on mixture of experts models. This is only needed for text, not images