Skip to content

Skills · Make it fast and big

Distributed training

Course coming soon

Data, tensor and pipeline parallelism: one model trained across many accelerators.

Mentioned in 80 of 339 recorded research roles (24%) and 166 of 1,827 technical roles (9%), in this recorded board.

Learn it here

The course page has its planned syllabus and a sign-up, which tells us how many people want it.

Explore opportunities

Everything here that teaches it

Nothing on this site teaches it yet. It is listed so you can see how often labs ask for it, and the course in preparation above has a sign-up.

Also in Make it fast and big: Inference and serving, PyTorch, JAX, GPU kernels.

Who asks for it

Recorded roles that mention it

166 recorded postings mention it. Here are the newest 60 research, fellowship, applied and ML-systems roles; the rest are on the role pages linked above. Each title opens the lab's own posting.

  1. Research Engineer, Inference Foundation ↗

    Mistral AI · Research scientists and engineers · No degree stated

  2. Research Engineer, Mid-Training ↗

    Cognition · Research scientists and engineers · PhD required

  3. Research Engineer, ML Infrastructure ↗

    Cognition · Research scientists and engineers · PhD required

  4. Research Engineer, Post-Training ↗

    Cognition · Research scientists and engineers · PhD required

  5. Staff Research Engineer (LLM Pre-Training) ↗

    JetBrains (Junie, Mellum) · Research scientists and engineers · No degree stated

  6. AI Research Engineer, Post-Training ↗

    Lovable · Research scientists and engineers · No degree stated

  7. Machine Learning Scientist ↗

    Relace · Research scientists and engineers · Master's, PhD or equivalent

  8. Research Scientist, Robotics ↗

    Allen Institute for AI (Ai2) · Research scientists and engineers · PhD required · $167k to $261k base

  9. Performance Engineer, GPU ↗

    Anthropic · ML systems and infrastructure · No degree stated · $280k to $850k base

  10. Research Engineer / Research Scientist, RL Frontiers ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  11. Research Engineer / Research Scientist, Tokens ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $500k base

  12. Research Engineer, Code RL (Reinforcement Learning) ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  13. Research Engineer, Discovery ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  14. Research Engineer, Machine Learning (RL Velocity) ↗

    Anthropic · Research scientists and engineers · No degree stated

  15. Research Engineer, Machine Learning (RL Velocity) ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  16. Research Engineer, Pretraining ↗

    Anthropic · Research scientists and engineers · Master's or PhD required

  17. Research Engineer, RL Engineering ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  18. Research Engineer/Research Scientist, Pre-training ↗

    Anthropic · Research scientists and engineers · Master's or PhD required · $350k to $850k base

  19. Staff Research Engineer, Discovery Team ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  20. Staff Software Engineer, Infrastructure (Distributed Systems) ↗

    Anthropic · ML systems and infrastructure · No degree stated

  21. Staff+ Software Engineer, Infrastructure (Distributed Systems) ↗

    Anthropic · ML systems and infrastructure · No degree stated · $320k to $485k base

  22. Applied Researcher, Audio ↗

    Cartesia · Research scientists and engineers · No degree stated · $200k to $350k base

  23. Principal Research Engineer, Post-Training ↗

    Character.AI · Research scientists and engineers · PhD or equivalent experience · $275k to $400k base

  24. Audio Inference Engineer, Model Efficiency ↗

    Cohere · ML systems and infrastructure · No degree stated

  25. Machine Learning Intern/Co-op (Winter 2027) ↗

    Cohere · Fellowships, residencies and internships · No degree stated

  26. Member of Technical Staff, Data Analysis and Evaluation ↗

    Cohere · Research scientists and engineers · No degree stated

  27. Member of Technical Staff, Integration/RL Team (Research Engineer) ↗

    Cohere · Research scientists and engineers · No degree stated

  28. Member of Technical Staff, Modeling ↗

    Cohere · Research scientists and engineers · No degree stated

  29. Member of Technical Staff, Post-Training ↗

    Cohere · Research scientists and engineers · No degree stated

  30. Member of Technical Staff, Training Infra Engineer ↗

    Cohere · ML systems and infrastructure · No degree stated

  31. Member of Technical Staff, Training Performance Engineer ↗

    Cohere · ML systems and infrastructure · No degree stated

  32. Research Internship (Winter 2027) ↗

    Cohere · Fellowships, residencies and internships · PhD required

  33. Senior Member of Technical Staff, Multimodal AI ↗

    Cohere · Research scientists and engineers · No degree stated

  34. Senior Member of Technical Staff, Safety and Security for Agents ↗

    Cohere · Research scientists and engineers · No degree stated

  35. Senior ML Systems Engineer, Frameworks & Tooling ↗

    Cohere · ML systems and infrastructure · No degree stated

  36. Senior Software Engineer, GPU Infrastructure (HPC) ↗

    Cohere · ML systems and infrastructure · No degree stated

  37. Research Scientist, Robotics RL, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD or equivalent experience

  38. Software Engineer, Model Inference, DeepMind ↗

    Google DeepMind · ML systems and infrastructure · Bachelor's or equivalent

  39. Research Engineer / Scientist, Post-training - Paris ↗

    H Company · Research scientists and engineers · Master's or PhD required

  40. Research Engineer, Training & Inference ↗

    Harmonic · Research scientists and engineers · PhD preferred · $200k to $450k base

  41. Principal Research Engineer, Model Training & Post-Training ↗

    Inflection AI · Research scientists and engineers · PhD or equivalent experience · $400k to $550k base

  42. ML Research Engineer, London ↗

    Isomorphic Labs · Research scientists and engineers · Master's, PhD or equivalent

  43. Research Engineer (LLM Performance), London ↗

    Isomorphic Labs · Research scientists and engineers · No degree stated

  44. Member of Technical Staff - Distributed Training Engineer ↗

    Liquid AI · ML systems and infrastructure · No degree stated

  45. Member of Technical Staff - GPU Infrastructure Engineer ↗

    Liquid AI · ML systems and infrastructure · No degree stated

  46. Member of Technical Staff - Multi-Modal, Audio ↗

    Liquid AI · Research scientists and engineers · No degree stated

  47. Research Scientist - World Model ↗

    Luma AI · Research scientists and engineers · PhD or equivalent experience

  48. Research Scientist / Engineer – Performance Optimization ↗

    Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base

  49. Research Scientist / Engineer – Reinforcement Learning Infrastructure ↗

    Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base

  50. Research Scientist / Engineer – Training Infrastructure ↗

    Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base

  51. Research Scientist / Engineer — Foundation Model (Agent) ↗

    Luma AI · Research scientists and engineers · No degree stated

  52. Member of Technical Staff, Kernels ↗

    Magic · ML systems and infrastructure · No degree stated · $275k to $550k base

  53. Research Engineer, Safety Evaluation ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD required

  54. Research Scientist, Artificial Intelligence ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD or equivalent experience

  55. AI Scientist ↗

    Mistral AI · Research scientists and engineers · No degree stated

  56. Applied Scientist ↗

    Mistral AI · Research scientists and engineers · PhD preferred