About
Their research covers efficient training and inference, hardware-aware algorithms, and sequence models. They hold a PhD from Stanford.
Known for
- 01
FlashAttention series of fast exact attention kernels
- 02
Mamba and structured state space duality
- 03
Monarch structured matrices
- 04
COLM 2024 Outstanding Paper award for Mamba
Activity
- zoo★ 9
- cutlass★ 4
CUDA Templates and Python DSLs for High-Performance Linear Algebra
- leastsquares★ 4
CS 240H final project
- trlx★ 2
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
Works per year
11.8k citations
5.9k citations
2.4k citations
2k citations
Public data only, fetched 2026-11-17. GitHub counts cover public contributions; Hugging Face counts are repositories created; research data comes from OpenAlex.
Labs
Sources
Compiled from public sources. Something wrong, or would you like this page changed or removed? Tell us on Discord or open an issue on GitHub and we will act promptly.
