EPFL, ETH Zurich and the Swiss National Supercomputing Centre (CSCS) released Apertus today, Switzerland’s first large-scale, open, multilingual language model — a milestone in generative AI for transparency and diversity.

you are viewing a single comment's thread
view the rest of the comments

[–] hendrik@palaver.p3x.de 10 points 2 months ago* (last edited 2 months ago) (1 children)

Nice. This is the one that supposedly comes with open data sets, training data and everything, and it's a true "open-source" model. Seems it's avalable in 7B and 70B.

[–] Fitik@fedia.io 5 points 2 months ago

Yup, I see pretrain data on their GitHub, cool to see it released

https://github.com/swiss-ai/pretrain-data