Skip to content
View roymiles's full-sized avatar
🚲
🚲
46 followers · 34 following

Achievements

Achievement: Pair ExtraordinaireAchievement: Pull Sharkx2Achievement: StarstruckAchievement: Arctic Code Vault Contributor

Achievements

Achievement: Pair ExtraordinaireAchievement: Pull Sharkx2Achievement: StarstruckAchievement: Arctic Code Vault Contributor

Block or report roymiles

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
roymiles/README.md

I'm into model distillation, efficient fine-tuning, and building practical ML systems that scale. I also enjoy open-source, side projects, and making research code actually usable.

Pinned Loading

  1. huggingface/peft huggingface/peft Public

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python 21.3k 2.4k

  2. VkD VkD Public

    [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections

    Python 58 2

  3. ITRD ITRD Public

    [BMVC 2022] Information Theoretic Representation Distillation

    Python 19 1

  4. Simple-Recipe-Distillation Simple-Recipe-Distillation Public

    [AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation

    Jupyter Notebook 20 1

  5. VeLoRA VeLoRA Public

    [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections

    Python 22 3

  6. diffusion-stitching diffusion-stitching Public

    Stitching Noisy Diffusion Thoughts for Better Reasoning

    Python 8