About
Repositories cover attention and transformer variants, diffusion models, audio models and protein structure prediction.
GitHub account with about 61,000 followers, known for many widely starred open source PyTorch implementations of research papers.
Known for
- 01
audiolm-pytorch
- 02
alphafold3-pytorch and alphafold2 reimplementations
- 03
Reference implementations of attention and transformer papers
- 04
Large library of PyTorch paper reimplementations
Activity
- vit-pytorch★ 25.6k
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- DALLE2-pytorch★ 11.3k
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
- denoising-diffusion-pytorch★ 10.7k
Implementation of Denoising Diffusion Probabilistic Model in Pytorch
- imagen-pytorch★ 8.4k
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
- PaLM-rlhf-pytorch★ 7.9k
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
Public data only, fetched 2026-11-17. GitHub counts cover public contributions; Hugging Face counts are repositories created; research data comes from OpenAlex.
Sources
Compiled from public sources. Something wrong, or would you like this page changed or removed? Tell us on Discord or open an issue on GitHub and we will act promptly.
