A from-scratch implementation of a small language model, built part by part, from a text file to a system capable of generation, classification, instruction following, parameter-efficient adaptation, and reasoning-style preference training.
machine-learning natural-language-processing tokenizer transformer fine-tuning self-attention transformer-encoder transformer-architecture tokenizer-parser self-attention-implementation transformers-models fine-tuning-nlp tokenizer-nlp reasoning-agents fine-tuning-llm reasoning-language-models llm-from-scratch tokenizer-bpe build-llm build-llm-from-scratch
-
Updated
Sep 3, 2026 - Python