Skills · Make it fast and big
Distributed training
Course coming soon
Data, tensor and pipeline parallelism: one model trained across many accelerators.
Mentioned in 80 of 339 recorded research roles (24%) and 166 of 1,827 technical roles (9%), in this recorded board.
Learn it here
The course page has its planned syllabus and a sign-up, which tells us how many people want it.
Everything here that teaches it
Nothing on this site teaches it yet. It is listed so you can see how often labs ask for it, and the course in preparation above has a sign-up.
Also in Make it fast and big: Inference and serving, PyTorch, JAX, GPU kernels.
Who asks for it
- Research scientists and engineers 80 of 339
- Fellowships, residencies and internships 4 of 32
- Applied AI and forward-deployed 4 of 326
- ML systems and infrastructure 27 of 102
- Machine learning engineers 19 of 143
- Software engineering at labs 32 of 885
Recorded roles that mention it
166 recorded postings mention it. Here are the newest 60 research, fellowship, applied and ML-systems roles; the rest are on the role pages linked above. Each title opens the lab's own posting.
- Research Engineer, Inference Foundation ↗
Mistral AI · Research scientists and engineers · No degree stated
- Research Engineer, Mid-Training ↗
Cognition · Research scientists and engineers · PhD required
- Research Engineer, ML Infrastructure ↗
Cognition · Research scientists and engineers · PhD required
- Research Engineer, Post-Training ↗
Cognition · Research scientists and engineers · PhD required
- Staff Research Engineer (LLM Pre-Training) ↗
JetBrains (Junie, Mellum) · Research scientists and engineers · No degree stated
- AI Research Engineer, Post-Training ↗
Lovable · Research scientists and engineers · No degree stated
- Machine Learning Scientist ↗
Relace · Research scientists and engineers · Master's, PhD or equivalent
- Research Scientist, Robotics ↗
Allen Institute for AI (Ai2) · Research scientists and engineers · PhD required · $167k to $261k base
- Performance Engineer, GPU ↗
Anthropic · ML systems and infrastructure · No degree stated · $280k to $850k base
- Research Engineer / Research Scientist, RL Frontiers ↗
Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base
- Research Engineer / Research Scientist, Tokens ↗
Anthropic · Research scientists and engineers · No degree stated · $350k to $500k base
- Research Engineer, Code RL (Reinforcement Learning) ↗
Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base
- Research Engineer, Discovery ↗
Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base
- Research Engineer, Machine Learning (RL Velocity) ↗
Anthropic · Research scientists and engineers · No degree stated
- Research Engineer, Machine Learning (RL Velocity) ↗
Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base
- Research Engineer, Pretraining ↗
Anthropic · Research scientists and engineers · Master's or PhD required
- Research Engineer, RL Engineering ↗
Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base
- Research Engineer/Research Scientist, Pre-training ↗
Anthropic · Research scientists and engineers · Master's or PhD required · $350k to $850k base
- Staff Research Engineer, Discovery Team ↗
Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base
- Staff Software Engineer, Infrastructure (Distributed Systems) ↗
Anthropic · ML systems and infrastructure · No degree stated
- Staff+ Software Engineer, Infrastructure (Distributed Systems) ↗
Anthropic · ML systems and infrastructure · No degree stated · $320k to $485k base
- Applied Researcher, Audio ↗
Cartesia · Research scientists and engineers · No degree stated · $200k to $350k base
- Principal Research Engineer, Post-Training ↗
Character.AI · Research scientists and engineers · PhD or equivalent experience · $275k to $400k base
- Audio Inference Engineer, Model Efficiency ↗
Cohere · ML systems and infrastructure · No degree stated
- Machine Learning Intern/Co-op (Winter 2027) ↗
Cohere · Fellowships, residencies and internships · No degree stated
- Member of Technical Staff, Data Analysis and Evaluation ↗
Cohere · Research scientists and engineers · No degree stated
- Member of Technical Staff, Integration/RL Team (Research Engineer) ↗
Cohere · Research scientists and engineers · No degree stated
- Member of Technical Staff, Modeling ↗
Cohere · Research scientists and engineers · No degree stated
- Member of Technical Staff, Post-Training ↗
Cohere · Research scientists and engineers · No degree stated
- Member of Technical Staff, Training Infra Engineer ↗
Cohere · ML systems and infrastructure · No degree stated
- Member of Technical Staff, Training Performance Engineer ↗
Cohere · ML systems and infrastructure · No degree stated
- Research Internship (Winter 2027) ↗
Cohere · Fellowships, residencies and internships · PhD required
- Senior Member of Technical Staff, Multimodal AI ↗
Cohere · Research scientists and engineers · No degree stated
- Senior Member of Technical Staff, Safety and Security for Agents ↗
Cohere · Research scientists and engineers · No degree stated
- Senior ML Systems Engineer, Frameworks & Tooling ↗
Cohere · ML systems and infrastructure · No degree stated
- Senior Software Engineer, GPU Infrastructure (HPC) ↗
Cohere · ML systems and infrastructure · No degree stated
- Research Scientist, Robotics RL, DeepMind ↗
Google DeepMind · Research scientists and engineers · PhD or equivalent experience
- Software Engineer, Model Inference, DeepMind ↗
Google DeepMind · ML systems and infrastructure · Bachelor's or equivalent
- Research Engineer / Scientist, Post-training & Reinforcement Learning - London ↗
H Company · Research scientists and engineers · PhD preferred
- Research Engineer / Scientist, Post-training - Paris ↗
H Company · Research scientists and engineers · Master's or PhD required
- Research Engineer, Training & Inference ↗
Harmonic · Research scientists and engineers · PhD preferred · $200k to $450k base
- Principal Research Engineer, Model Training & Post-Training ↗
Inflection AI · Research scientists and engineers · PhD or equivalent experience · $400k to $550k base
- ML Research Engineer, London ↗
Isomorphic Labs · Research scientists and engineers · Master's, PhD or equivalent
- Research Engineer (LLM Performance), London ↗
Isomorphic Labs · Research scientists and engineers · No degree stated
- Member of Technical Staff - Distributed Training Engineer ↗
Liquid AI · ML systems and infrastructure · No degree stated
- Member of Technical Staff - GPU Infrastructure Engineer ↗
Liquid AI · ML systems and infrastructure · No degree stated
- Member of Technical Staff - Multi-Modal, Audio ↗
Liquid AI · Research scientists and engineers · No degree stated
- Research Scientist - World Model ↗
Luma AI · Research scientists and engineers · PhD or equivalent experience
- Research Scientist / Engineer – Performance Optimization ↗
Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base
- Research Scientist / Engineer – Reinforcement Learning Infrastructure ↗
Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base
- Research Scientist / Engineer – Training Infrastructure ↗
Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base
- Research Scientist / Engineer — Foundation Model (Agent) ↗
Luma AI · Research scientists and engineers · No degree stated
- Member of Technical Staff, Kernels ↗
Magic · ML systems and infrastructure · No degree stated · $275k to $550k base
- Research Engineer, Safety Evaluation ↗
Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD required
- Research Scientist, AI & Systems Co-Design (PhD) ↗
Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD required
- Research Scientist, Artificial Intelligence ↗
Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD or equivalent experience
- Research Scientist, Contextual AI and Multimodal Agents ↗
Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD required
- Software Engineer, AI Kernels & Performance Optimization — MTIA Software ↗
Meta (Superintelligence Labs and FAIR) · ML systems and infrastructure · Master's, PhD or equivalent
- AI Scientist ↗
Mistral AI · Research scientists and engineers · No degree stated
- Applied Scientist ↗
Mistral AI · Research scientists and engineers · PhD preferred