// Project
mvGPT - Minimum Viable GPT
A language model from scratch, to understand one from the ground up: a GPT defined in PyTorch and taken through the whole training pipeline - pretraining, fine-tuning and reinforcement learning - with the evaluation and metrics that show what it learned, then deployed so anyone can talk to it in the browser. Built episode by episode on YouTube, with the models on Hugging Face.
PyTorch
LLMs
RL
Video series