#model-distillation

Model distillation just turned training into intellectual property laundering

Teaching smaller models to mimic larger ones isn't optimisation, it's just copying homework with extra steps.