State of GPT

"State of GPT" is a landmark educational session delivered by Andrej Karpathy at Microsoft Build 2023, hosted on build.microsoft.com. It covers the complete GPT assistant training pipeline — from tokenization and pretraining through supervised fine-tuning and Reinforcement Learning from Human Feedback (RLHF). The session also dives into practical prompt engineering strategies, LLM psychology, fine-tuning techniques, and the rapidly growing ecosystem of tools built on top of large language models.