Model Distillation Explained
AI Terms · advanced
Learn how knowledge distillation compresses large teacher models into smaller, faster student models.
Quizzes in this topic
- Quiz 1: Distillation Basics
- Quiz 2: Temperature and Soft Targets
- Quiz 4: The Training Recipe
- Quiz 3: Distillation Variants
- Quiz 5: Capacity Gap and Inherited Flaws
- Quiz 6: Distillation for Language Models
- Quiz 7: Deployment Decisions
Every topic has slides to teach you, then quizzes to prove you know it. Retake anytime to raise your score.