
Community collective · Germany
Occiglot
An informal European research collective that released Occiglot-7B models, multilingual web datasets and tokenizer analyses for European languages.
Germany
- Founded
- 2024
- Type
- Community collective
- Based in
- Germany
- Key papers
- 1
- Featured projects
- 8
About
Occiglot describes itself as an ongoing research collective and an informal community of motivated individuals building open multilingual language models for Europe. Its announcement in March 2024 framed the work as preserving linguistic diversity and AI sovereignty in Europe.
The group released continually pre-trained Occiglot-7B models for German, French, Italian, Spanish and combined European language sets in March 2024, followed by the Occiglot-Fineweb dataset and German models built with DiscoResearch. It also published a tokenizer evaluation for European languages and contributed to the Community OSCAR web corpus.
The page names contributors Manuel Brack, Malte Ostendorff and Pedro Ortiz Suarez, and invites collaborators through its Discord server.
Mission and ambitionsOcciglot works to build transparent, open-source multilingual language models for European languages through an open community.
Known for
- 01
Occiglot-7B multilingual European models
- 02
Occiglot-Fineweb dataset
- 03
European language tokenizer evaluation
- 04
Community OSCAR web data
Milestones
- 2024
Occiglot announcement
The collective published its mission post on 6 March 2024.
- 2024
Occiglot-7B model family
Language-specific and eu5 Occiglot-7B models appeared on Hugging Face in early March 2024.
- 2024
Tokenizer evaluation
An analysis of tokenizers on European languages published on 11 March 2024.
- 2024
Occiglot-Fineweb
A preliminary dataset of about 230 million cleaned documents in 10 languages.
- 2024
German Llama-3 models
Base, instruct and long-context German models built with DiscoResearch on 65 billion German tokens.
- 2024
Community OSCAR
A multilingual web dataset built from 40 monthly Common Crawl snapshots, announced in August 2024.
Open source
Evaluation harness for European language models (6 stars)
Raw data and scripts for the technical report (6 stars)
Collection of good and bad web domains for LLM pretraining data (4 stars)
Main organisation repository (4 stars)
Italian-English instruction-tuned 7B model.
German-English instruction-tuned 7B model.
Tokenizer benchmark data from Wikipedia.
European LLM leaderboard.
Research papers
Notable releases
Openness
Models, datasets and evaluation code are public on Hugging Face and GitHub.
People
- Manuel BrackContributor
- Malte OstendorffContributor
- Pedro Ortiz SuarezContributor
Listed from the lab's own pages and public profiles.
Contact and community
Occiglot's site invites contact and Discord joining from people working on multilingual LLMs.
Discord of the informal collective for discussing multilingual LLM work; the site invites newcomers and collaborators to join.
Sources
Compiled from the lab's public pages, Hugging Face and GitHub. Last checked 2026-11-17. Something wrong or out of date? Tell us on Discord.



