EPFL, ETH Zurich and the Swiss National Supercomputing Centre (CSCS) released Apertus today, Switzerland’s first large-scale, open, multilingual language model — a milestone in generative AI for transparency and diversity.

First “modern and powerful” open source LLM?

Key features

  • Fully open model: open weights + open data + full training details including all data and training recipes
  • Massively Multilingual: 1811 natively supported languages
  • Compliant Apertus is trained while respecting opt-out consent of data owners (even retrospectivey), and avoiding memorization of training data
      • hperrin@lemmy.caEnglish
        222·
        3日前

        Hmm. That’s a shame. I wonder if there’s a community that’s just about open source code, not all of the other things people feel like labeling open source.

        • lime!@feddit.nuEnglish
          22·
          3日前

          …what? open source is a standardized term defined by the OSI. it’s a licencing term.

        • Sonalder@lemmy.ml
          7·
          3日前

          You should check some FOSS, FLOSS communities. Free(dom)/Libre and Open Source Software is more important than Open Source Software itslef in my honest opinion.

          Open Source can be applied to hardware, medicine, lessons, construction blueprints schematics, not only code.

    • Sonalder@lemmy.ml
      22·
      3日前

      Open Source is a way to create but is not limited to only software but many different things. LLMs are software. Most open source LLMs are using Open washing to label themselves as Open Source, however it is not. The importance in Open Source is being able to study how it was made and most of open models have closed training data-sets and training method. Apertus is trully open in the sense that they published Open Data and full training details.

      You have the right to be bother by “AI” but let Open Source enthousiasts being… well, enthousiasts when in a field of Open Washing someone created something trully Open Source to the point of sharing it in an Open Source community on a FOSS plateform.

      Edit : Minor corrections