systematic-diffusion

Here is 1 public repository matching this topic...

sutd-visual-computing-group / LS-KD-compatibility

[ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.

machine-translation pytorch imagenet knowledge-distillation label-smoothing iwslt cub200-2011 systematic-diffusion

Updated Dec 8, 2022
Python

Add this topic to your repo

To associate your repository with the systematic-diffusion topic, visit your repo's landing page and select "manage topics."

Learn more