Skip to content

ModelTC/ComfyUI-LightVAE

Repository files navigation

ComfyUI-LightVAE

LightX2V

High-Performance VAE Custom Nodes

HuggingFace GitHub License

English | ็ฎ€ไฝ“ไธญๆ–‡

๐Ÿ“– Introduction

ComfyUI-LightVAE is a collection of LightX2V VAE custom nodes designed for ComfyUI, supporting high-performance video VAE models including LightVAE and LightTAE.

The LightX2V team has deeply optimized VAE, creating two major series: LightVAE and LightTAE, which significantly reduce memory usage and improve inference speed while maintaining high quality.

โœจ Key Features

๐ŸŽฏ LightVAE Series

Feature: Best Balance โš–๏ธ

  • โœ… Uses Causal 3D Conv (same as official)
  • โœ… Near-official quality โญโญโญโญ
  • โœ… ~50% less memory (~4-5 GB)
  • โœ… 2-3x faster
  • โœ… Balances quality, speed, and memory ๐Ÿ†

โšก LightTAE Series

Feature: Ultra-fast + High Quality ๐Ÿ†

  • โœ… Minimal memory usage (~0.4 GB)
  • โœ… Lightning-fast inference
  • โœ… Near-official quality โญโญโญโญ
  • โœ… Surpasses open-source TAE

๐Ÿš€ Performance Comparison

Test Environment: H100 GPU, BF16, 81-frame video (480P)

Model Encode Time Decode Time Encode Memory Decode Memory Quality
lightvaew2_1 1.5s 2.1s 4.8GB 5.6GB โญโญโญโญโญ
lighttaew2_1 0.4s 0.25s 0.009GB 0.4GB โญโญโญโญ
Wan2.1_VAE 4.2s 5.5s 8.5GB 10.1GB โญโญโญโญ
taew2_1 0.4s 0.25s 0.009GB 0.4GB โญโญโญ

Performance Improvements:

  • ๐Ÿš€ LightVAE is 2-3x faster than official VAE, 50% less memory
  • โšก LightTAE is 10+ times faster than official VAE, 95%+ less memory
  • ๐ŸŽจ Near-official VAE quality, surpasses open-source TAE

๐Ÿ“ฆ Installation

1. Install LightX2V Dependencies

vae requirements windows example

...comfy\python_embeded\python.exe -s -m pip install -r requirements.txt

# Clone LightX2V repository
git clone https://github.com/ModelTC/LightX2V
cd LightX2V

python setup_vae.py install
# windows example
...comfy\python_embeded\python.exe setup_vae.py install

2. Install ComfyUI-WanVideoWrapper

LightVAE nodes depend on WanVideoWrapper for main model support:

cd ComfyUI/custom_nodes
git clone https://github.com/kijai/ComfyUI-WanVideoWrapper

3. Install ComfyUI-LightVAE

cd ComfyUI/custom_nodes
git clone https://github.com/YOUR_USERNAME/ComfyUI-LightVAE

4. Restart ComfyUI

๐Ÿ“ฅ Download Models

Main Models (Diffusion Models)

Option 1: Distilled Models (Recommended, 4-step)

Option 2: Original Models (20-step)

# Download to ComfyUI/models/diffusion_models/
huggingface-cli download lightx2v/Wan2.1/2-Distill-Models \
    --local-dir ./ComfyUI/models/diffusion_models/

VAE Models

All VAE Models (Required):

# Download all VAE models
huggingface-cli download lightx2v/Autoencoders \
    --local-dir ./ComfyUI/models/vae/

# Or download only what you need (Recommended)
huggingface-cli download lightx2v/Autoencoders lightvaew2_1.pth \
    --local-dir ./ComfyUI/models/vae/

Supported VAE Models:

  • Wan2.1_VAE.pth / .safetensors - Official VAE 2.1
  • Wan2.2_VAE.pth / .safetensors - Official VAE 2.2
  • lightvaew2_1.pth / .safetensors - Optimized VAE 2.1 โญ Recommended
  • taew2_1.pth / .safetensors - Open-source TAE 2.1
  • taew2_2.pth / .safetensors - Open-source TAE 2.2
  • lighttaew2_1.pth / .safetensors - Optimized TAE 2.1 โšก Fastest
  • lighttaew2_2.pth / .safetensors - Optimized TAE 2.2

๐ŸŽฏ Node Documentation

1. LightX2V VAE Decoder Loader

VAE Loader

Input Parameters:

  • vae_filename - VAE model filename (automatically lists from ./models/vae/)
  • dtype - Data type (bfloat16 / float16 / float32)
  • device - Compute device (cuda / cpu)

Output:

  • vae - VAE model object

Features:

  • โœ… Automatically identifies VAE type from filename
  • โœ… Supports all LightX2V VAE models

2. LightX2V VAE Decode

VAE Decode

Input Parameters:

  • vae - VAE object from Loader
  • latent - Latent representation

Output:

  • IMAGE - Decoded video frames

Supports:

  • โœ… All VAE series (WanVAE, LightVAE)
  • โœ… All TAE series (TAE, LightTAE)

๐Ÿ–ผ๏ธ Example Workflows

Wan2.1 I2V 4-step FP8 + LightVAE

High-performance configuration using 4-step distilled model + LightVAE optimized decoder.

Workflow File: example/workflows/wan2.1_I2V_4step_fp8_lightvae.json

Wan2.2 TI2V + LightVAE

Wan2.2 Text-Image-to-Video + LightVAE decoding.

Workflow File: example/workflows/wan2.2_TI2V_lightvae.json

โš ๏ธ Important Notes

Model Compatibility

  • โš ๏ธ Wan2.1 VAE can only be used with Wan2.1/Wan2.2-A1B backbone models
  • โš ๏ธ Wan2.2 VAE can only be used with Wan2.2 TI2V backbone models
  • โŒ Do not mix different versions of VAE and backbone models

๐Ÿ“š Related Resources

๐Ÿ™ Acknowledgements

If this project helps you, please give a โญ to LightX2V and this repository!

๐Ÿ“ž Support

Enjoy using LightX2V VAE! ๐Ÿš€

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages