
Institute · Paris, France
ALMAnaCHInria
Inria Paris research team behind the CamemBERT family of open French language models and work in computational humanities.
Paris, France
- Type
- Institute
- Based in
- Paris, France
- Key papers
- 2
- Featured projects
- 4
About
ALMAnaCH is an Inria team in Paris working on natural language processing and digital humanities. Its members include Benoît Sagot and Djamé Seddah, who are authors of the original CamemBERT paper alongside colleagues from Inria and Sorbonne Université.
CamemBERT, a RoBERTa-based French model released under an MIT licence in 2019, became a widely adopted reference. CamemBERT 2.0 followed in 2024, and CamemBERTa, by Wissam Antoun, Sagot and Seddah, explored data-efficient training. The team's Hugging Face organization lists 92 models and 43 datasets, including biomedical encoders and Gaperon sparse autoencoders.
The models serve researchers, companies and public bodies that need open French and biomedical text processing.
Mission and ambitionsThe team builds and shares language models and data for French and historical or specialised text. It treats open release as part of academic practice.
Known for
- 01
CamemBERT French language model
- 02
CamemBERT 2.0 and CamemBERTa
- 03
French biomedical encoders
- 04
Digital humanities NLP
Milestones
- 2019
CamemBERT
Martin et al. released the reference open French language model (arXiv 1911.03894).
- 2023
CamemBERTa
Antoun, Sagot and Seddah published a data-efficient French language model.
- 2024
CamemBERT 2.0
Updated French encoders with a refreshed tokenizer and data were released (arXiv 2411.08868).
- 2025
Biomedical models and data
Published French biomedical encoders and datasets such as Biomed-Enriched.
Open source
Model with 117 likes on the Hub.
Model with 28 likes on the Hub.
- almanach/Biomed-Enricheddataset
Dataset with 10 likes on the Hub.
Space with 10 likes on the Hub.
Research papers
Notable releases
Openness
Models and datasets are public on Hugging Face under the almanach organisation; CamemBERT checkpoints have very high download counts.
People
- Benoît SagotResearcher, CamemBERT author
- Djamé SeddahSenior researcher at Inria
- Wissam AntounResearcher, CamemBERTa author
- Thibault ClériceMember of the almanach Hugging Face organization
- Nathan GodeyMember of the almanach Hugging Face organization
Listed from the lab's own pages and public profiles.
Contact and community
Contact through the Inria team page.
Sources
Compiled from the lab's public pages, Hugging Face and GitHub. Last checked 2026-11-17. Something wrong or out of date? Tell us on Discord.



