This repository contains working Elixir examples based on Build a Large Language Model from Scratch by Sebastian Raschka.
The goal of this project is to reimplement the ideas from the book in Elixir, chapter by chapter, as a way to understand them more deeply. The code is complete and runnable, but it is written with clarity and traceability in mind rather than micro-optimizations or idiomatic Elixir style.
The structure generally follows the progression of the book. Each chapter builds on the previous one, and many choices are made to mirror the concepts as they are introduced, even when more compact or idiomatic alternatives exist.
If you are looking for optimized implementations or best-in-class Elixir patterns, this repository is probably not what you want.
This is an independent Elixir implementation inspired by Build a Large Language Model from Scratch by Sebastian Raschka. It does not include or reproduce the book’s Python source code.
The original book and accompanying code are released under the Apache License 2.0. This repository uses the same license.
I am writing about this work as I go, primarily as a way to keep my own notes straight. Related posts and explanations are collected at: