Renaissance Labs

People

Independent

lucidrains Handle

@lucidrains

lucidrains is a GitHub account, whose owner uses the name Phil Wang publicly, that publishes open source implementations of recently released machine learning papers, mostly in PyTorch.

About

Repositories cover attention and transformer variants, diffusion models, audio models and protein structure prediction.

GitHub account with about 61,000 followers, known for many widely starred open source PyTorch implementations of research papers.

Known for

  1. 01

    audiolm-pytorch

  2. 02

    alphafold3-pytorch and alphafold2 reimplementations

  3. 03

    Reference implementations of attention and transformer papers

  4. 04

    Large library of PyTorch paper reimplementations

Activity

GitHub4.3k public contributions in the past year · 61.8k followers
101425281215610104142111151210166141812Dec1412164231116161015119811101251268161351913141518Jan28212071430312181012132010161613129101614241381321Feb2516242324238163922331231461191072061047131117Mar12137107996101212256115129369581910208143210123711Apr71045545427188613792815684966489May4157911114576201014941212165118210111212189179191010109Jun1010154551295111137101631713754188971216Jul132271945249101171511121719171417141491117246Aug139198142228263319262025162614121722201411189920121718147181989Sep91610641371615917138131014191821171613291141219Oct1114108716483101081573392716817135831212Nov157151110121868913162017315
Python
  • vit-pytorch★ 25.6k

    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

  • Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

  • Implementation of Denoising Diffusion Probabilistic Model in Pytorch

  • Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

  • Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Public data only, fetched 2026-11-17. GitHub counts cover public contributions; Hugging Face counts are repositories created; research data comes from OpenAlex.

Sources

Compiled from public sources. Something wrong, or would you like this page changed or removed? Tell us on Discord or open an issue on GitHub and we will act promptly.