Glossary / Distillation
DistillationDistilasi
Training a small model to imitate a big one, to keep much of the skill in a lighter package.
Melatih model kecil meniru model besar, supaya sebagian besar kemampuannya muat di paket yang lebih ringan.
Example
Contoh
Many small models are distilled from larger ones.
Banyak model kecil disuling dari model yang lebih besar.
Why it matters
Kenapa penting
It is why small models keep getting better.
Itu sebabnya model kecil terus membaik.