A research workshop on large language model gathering 1000+ researchers around the world
Follow the training of the 176B multilingual model live @BigScienceLLM
Our design for Jean Zay’s new covering translates the gradient descent, the mathematical heart of how AI learns, into color and form.
We actually studied the landscape loss of the BLOOM model from @BigscienceW, which was trained on Jean Zay, to create the artwork.
Packing for a weekend I found this.
It is hard to believe that @BigScienceLLM really happened. The first time I heard of the idea my take was "this is going to be fun... but not going to work"
Kudos to @Thom_Wolf for the vision