About
Their research covers efficient architectures, scaling and generalization. Schlag co-invented DeltaNet in the paper "Linear Transformers are Secretly Fast Weight Programmers".
Known for
- 01
Co-lead of the Apertus open LLM
- 02
DeltaNet fast weight programmers
- 03
Efficient neural architectures
Activity
Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
An example of data parallelism and async updates of parameter in tensorflow.
TensorFlow input pipelines for multiple datasets for easy data fetching
- TP-Transformer★ 49
- TPR-RNN★ 41
Code for the publication Learning to Reason with Third-Order Tensor Products.
Works per year
2.4k citations
528 citations
186 citations
158 citations
Public data only, fetched 2026-11-17. GitHub counts cover public contributions; Hugging Face counts are repositories created; research data comes from OpenAlex.
Labs
Sources
Compiled from public sources. Something wrong, or would you like this page changed or removed? Tell us on Discord or open an issue on GitHub and we will act promptly.
