Smarter model distillation, without the collapse
A new distillation method fixes a hidden failure where deeper supervision causes student models to collapse rather than improve.
A new distillation method fixes a hidden failure where deeper supervision causes student models to collapse rather than improve.