Show HN: Building an LLM from Scratch in TypeScript
I wanted to understand transformers at a level where nothing is magic, so I'm building a ChatGPT-style model from first principles in TypeScript. Why not Python? I've found that reimplementing concepts in a different language forces me to grasp the nuance of the implementation. Chapters cover dataloaders, embeddings, and the attention mechanism so far. Feedback welcome if anything's unclear.
Discussion Highlights (1 comments)
pluc
Why does it start at Chapter 2? Is it one of those JavaScript integer quirks?