Skip to content

unslothai/notebooks

Repository files navigation

📒 Fine-tuning Notebooks

Below are our notebooks for Google Colab categorized by model. You can view our Kaggle notebooks here.
Use our guided notebooks to prep data, train, evaluate, and save your model. View our main GitHub repo here.

Main Notebooks

Model Type Notebook Link
Gemma3N (4B) Inference Open in Colab
Qwen3 (14B) Conversational Open In Colab
Qwen3-Base (4B) GRPO Open In Colab
Gemma 3 (4B) Conversational Open In Colab
Llama 3.2 (3B) Conversational Open In Colab
Phi-4 (14B) Conversational Open In Colab
Llama 3.2 Vision (11B) Vision Open In Colab
Llama 3.1 (8B) Alpaca Open In Colab
Mistral v0.3 (7B) Conversational Open In Colab
DeepSeek-R1-0528-Qwen3 (8B) GRPO Open In Colab
Llama 3.2 (3B) by Meta Synthetic Data Open In Colab
Sesame-CSM (1B) TTS Open In Colab

Text-to-Speech (TTS) Notebooks

Model Type Notebook Link
Sesame-CSM TTS Open In Colab
Orpheus-TTS TTS Open In Colab
Spark-TTS TTS Open In Colab
Oute-TTS TTS Open In Colab
Oute-TTS TTS Open In Colab
Llasa TTS (1B) TTS Open In Colab
Llasa TTS (3B) TTS Open In Colab
Whisper-Large-V3 STT Open In Colab

Vision (Multimodal) Notebooks

Model Type Notebook Link
Llama 3.2 (11B) Vision Open In Colab
Qwen2.5 VL (7B) Vision Open In Colab
Pixtral (12B) Vision Open In Colab

BERT Notebooks

Model Notebook Link
ModernBERT-large Open In Colab

Specific use-case Notebooks

Usecase Model Notebook Link
Text Classification Llama 3.1 (8B) Open In Colab
Tool Calling Qwen2.5-Coder (1.5B) Open In Colab
Multiple Datasets Open In Colab
KTO Qwen2.5-Instruct (1.5B) Open In Colab
Inference Chat UI LLaMa 3.2 Vision Open In Colab
Conversational LLaMa 3.2 (1B and 3B) Open In Colab
ChatML Mistral (7B) Open In Colab
Text Completion Mistral (7B) Open In Colab

GRPO Notebooks

Model Type Notebook Link
Phi 4 (14B) GRPO Open in Colab
Llama3.1 (8B) GRPO Open in Colab
Meta Synthetic Data Llama3.1 (8B) GRPO Open in Colab
Qwen3 (4B) GRPO Open in Colab
Meta Synthetic Data Llama3 2 (3B) GRPO Open in Colab
Gemma3 (1B) GRPO Open in Colab
Qwen2.5 (3B) GRPO Open in Colab
DeepSeek R1 0528 Qwen3 (8B) GRPO Open in Colab
Mistral v0.3 (7B) GRPO Open in Colab

Gemma Notebooks

Model Type Notebook Link
CodeGemma (7B) Conversational Open in Colab
Gemma3 (4B) Vision Open in Colab
Gemma3 (4B) Open in Colab
Gemma3N (4B) Inference Open in Colab
Gemma2 (9B) Alpaca Open in Colab
Gemma2 (2B) Alpaca Open in Colab

Llama Notebooks

Model Type Notebook Link
Llama3.2 (11B) Vision Open in Colab
Llama3.2 (1B and 3B) Conversational Open in Colab
Llama3.2 (1B) RAFT Open in Colab
Llama3.1 (8B) Alpaca Open in Colab
Llama3.1 (8B) Inference Open in Colab
Llasa TTS (3B) TTS Open in Colab
Llama3 (8B) ORPO Open in Colab
Llama3 (8B) Alpaca Open in Colab
Llama3 (8B) Conversational Open in Colab
Llama3 (8B) Ollama Open in Colab
TinyLlama (1.1B) Alpaca Open in Colab
Llasa TTS (1B) TTS Open in Colab

Mistral Notebooks

Model Type Notebook Link
Mistral Small (22B) Alpaca Open in Colab
Mistral Nemo (12B) Alpaca Open in Colab
Pixtral (12B) Vision Open in Colab
Mistral (7B) Text Completion Open in Colab
Zephyr (7B) DPO Open in Colab
Mistral v0.3 (7B) Alpaca Open in Colab
Mistral v0.3 (7B) CPT Open in Colab
Mistral v0.3 (7B) Conversational Open in Colab

Orpheus Notebooks

Model Type Notebook Link
Orpheus (3B) TTS Open in Colab

Oute Notebooks

Model Type Notebook Link
Oute TTS (1B) TTS Open in Colab

Phi Notebooks

Model Type Notebook Link
Phi 4 Conversational Open in Colab
Phi 3.5 Mini Conversational Open in Colab
Phi 3 Medium Conversational Open in Colab

Qwen Notebooks

Model Type Notebook Link
Qwen3 (14B) Reasoning Conversational Open in Colab
Qwen3 (14B) Open in Colab
Qwen3 (14B) Alpaca Open in Colab
Qwen2.5 Coder (1.5B) Tool Calling Open in Colab
Qwen2.5 (7B) Alpaca Open in Colab
Qwen2.5 Coder (14B) Conversational Open in Colab
Qwen2.5 VL (7B) Vision Open in Colab
Qwen2 VL (7B) Vision Open in Colab
Qwen2 (7B) Alpaca Open in Colab

Spark Notebooks

Model Type Notebook Link
Spark TTS (0 5B) TTS Open in Colab

Whisper Notebooks

Model Type Notebook Link
Whisper Open in Colab

Other Notebooks

Model Type Notebook Link
Magistral (24B) Reasoning Conversational Open in Colab
Sesame CSM (1B) TTS Open in Colab
Unsloth Studio Open in Colab
CodeForces cot Finetune for Reasoning on CodeForces Reasoning Open in Colab

📒 Kaggle Notebooks

Click for all our Kaggle notebooks categorized by model:

GRPO Notebooks

Model Type Notebook Link
Phi 4 (14B) GRPO Open in Kaggle
Meta Synthetic Data Llama3.1 (8B) GRPO Open in Kaggle
Llama3.1 (8B) GRPO Open in Kaggle
Gemma3 (1B) GRPO Open in Kaggle
Meta Synthetic Data Llama3 2 (3B) GRPO Open in Kaggle
Qwen3 (4B) GRPO Open in Kaggle
Qwen2.5 (3B) GRPO Open in Kaggle
DeepSeek R1 0528 Qwen3 (8B) GRPO Open in Kaggle
Mistral v0.3 (7B) GRPO Open in Kaggle

Gemma Notebooks

Model Type Notebook Link
CodeGemma (7B) Conversational Open in Kaggle
Gemma3 (4B) Open in Kaggle
Gemma3N (4B) Inference Open in Kaggle
Gemma3 (4B) Vision Open in Kaggle
Gemma2 (2B) Alpaca Open in Kaggle
Gemma2 (9B) Alpaca Open in Kaggle

Llama Notebooks

Model Type Notebook Link
Llama3.2 (1B and 3B) Conversational Open in Kaggle
Llama3.2 (11B) Vision Open in Kaggle
Llama3.2 (1B) RAFT Open in Kaggle
Llama3.1 (8B) Inference Open in Kaggle
Llama3.1 (8B) Alpaca Open in Kaggle
Llasa TTS (3B) TTS Open in Kaggle
Llama3 (8B) Ollama Open in Kaggle
Llama3 (8B) Conversational Open in Kaggle
Llama3 (8B) ORPO Open in Kaggle
Llama3 (8B) Alpaca Open in Kaggle
TinyLlama (1.1B) Alpaca Open in Kaggle
Llasa TTS (1B) TTS Open in Kaggle

Mistral Notebooks

Model Type Notebook Link
Mistral Small (22B) Alpaca Open in Kaggle
Mistral Nemo (12B) Alpaca Open in Kaggle
Pixtral (12B) Vision Open in Kaggle
Mistral (7B) Text Completion Open in Kaggle
Zephyr (7B) DPO Open in Kaggle
Mistral v0.3 (7B) CPT Open in Kaggle
Mistral v0.3 (7B) Alpaca Open in Kaggle
Mistral v0.3 (7B) Conversational Open in Kaggle

Orpheus Notebooks

Model Type Notebook Link
Orpheus (3B) TTS Open in Kaggle

Oute Notebooks

Model Type Notebook Link
Oute TTS (1B) TTS Open in Kaggle

Phi Notebooks

Model Type Notebook Link
Phi 4 Conversational Open in Kaggle
Phi 3.5 Mini Conversational Open in Kaggle
Phi 3 Medium Conversational Open in Kaggle

Qwen Notebooks

Model Type Notebook Link
Qwen3 (14B) Alpaca Open in Kaggle
Qwen3 (14B) Open in Kaggle
Qwen3 (14B) Reasoning Conversational Open in Kaggle
Qwen2.5 Coder (14B) Conversational Open in Kaggle
Qwen2.5 (7B) Alpaca Open in Kaggle
Qwen2.5 Coder (1.5B) Tool Calling Open in Kaggle
Qwen2.5 VL (7B) Vision Open in Kaggle
Qwen2 VL (7B) Vision Open in Kaggle
Qwen2 (7B) Alpaca Open in Kaggle

Spark Notebooks

Model Type Notebook Link
Spark TTS (0 5B) TTS Open in Kaggle

Whisper Notebooks

Model Type Notebook Link
Whisper Open in Kaggle

Other notebooks Notebooks

Model Type Notebook Link
Magistral (24B) Reasoning Conversational Open in Kaggle
Sesame CSM (1B) TTS Open in Kaggle
CodeForces cot Finetune for Reasoning on CodeForces Reasoning Open in Kaggle
Unsloth Studio Open in Kaggle

✨ Contributing to Notebooks

If you'd like to contribute to our notebooks, here's a guide to get you started:

  1. Find the Template: We've provided a template notebook called Template_Notebook.ipynb in the root directory of this project. This template contains the basic structure and formatting guidelines for all notebooks in this collection.
  2. Create Your Notebook:
    • Make a copy of Template_Notebook.ipynb.
    • Rename the copied file to follow this naming convention:
      • LLM Notebooks: <Model Name>-<Type>.ipynb (e.g., Mistral_v0.3_(7B)-Alpaca.ipynb)
      • Vision Notebooks: <Model Name>-Vision.ipynb (e.g., Llava_v1.6_(7B)-Vision.ipynb)
      • Example of <Type>: Alpaca, Conversational, CPT, DPO, ORPO, Text_Completion, CSV, Inference, Unsloth_Studio
  3. Place in original_template: Once your notebook is ready, move it to the original_template directory.
  4. Update Notebooks: Run the following command in your terminal:
    python update_all_notebooks.py
    This script will automatically:
    • Copy your notebook from original_template to the notebooks directory.
    • Update the notebook's internal sections (like Installation, News) to ensure consistency.
    • Add your notebook to the appropriate list in this README.md file.
  5. Create a Pull Request: After that, just create a pull request (PR) to merge your changes, making it available for everyone!
    • We appreciate your contributions and look forward to reviewing your notebooks!

About

Fine-tune LLMs for free with 100+ Notebooks on Google Colab, Kaggle, and more.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages