ESP32S3 cluster running 1.58-bit (BitNet) Language model

cameron_b

It is a bit of a bummer to see that the degree of 'compression' makes it a fancy llm noise-maker. It is still charming.

sjakati98

Gemma 4 when?

tdhz77

Soon ai in every lightbulb running Kubernetes

matthewfcarlson

I’m actually working on a small project that’s exactly this! Less quant so it’s only 150M parameters but this is amazing.

NDlurker

I'm curious how this would handle grammar checking on a basic word processor. Or maybe generate worlds for small text based games. I have no idea what the capabilities are of a cluster like this.

nonasking_

Thanks for sharing. It's fascinating to see a 0.5B LLM being split across seven ESP32s like this.