Been heads down working on our next text-to-video model, but we're going to be publishing some exciting research updates over the next few weeks!
Here's an appetizer - How do you build pre-training datasets that accelerate model convergence?
linum.ai/field-notes/da…
We trained Linum-v2 on a big cluster over the holidays and didn't want to spend the whole time refreshing our Weights & Biases from our phones.
So we built a simple $8/month tool to just call us when something crashed.
Open-sourcing it, in case it can help other foundation
Turns out better VAE reconstruction quality can make your diffusion model worse.
We learned this the hard way over 4 months.
Writeup + open-source Image-Video VAE model.
linum.ai/field-notes/va…
