Skip to content

Skills · Make it fast and big

Distributed training

Course coming soon

Data, tensor and pipeline parallelism: one model trained across many accelerators.

Mentioned in 80 of 338 recorded research roles (24%) and 171 of 1,837 technical roles (9%), as of October 2, 2026.

Learn it here

The course page has its planned syllabus and a sign-up, which tells us how many people want it.

These counts describe the October 2, 2026 snapshot; postings need a fresh check. Explore opportunities.

Everything here that teaches it

Nothing on this site teaches it yet. It is listed so you can see how often labs ask for it, and the course in preparation above has a sign-up.

Also in Make it fast and big: Inference and serving, PyTorch, JAX, GPU kernels.

Who asks for it

Recorded roles that mention it

171 recorded postings mention it. Here are the newest 60 research, fellowship, applied and ML-systems roles; the rest are on the role pages linked above. Each title opens the lab's own posting.

  1. Research Engineer, Mid-Training ↗

    Cognition · Research scientists and engineers · PhD required

  2. Research Engineer, ML Infrastructure ↗

    Cognition · Research scientists and engineers · PhD required

  3. Research Engineer, Post-Training ↗

    Cognition · Research scientists and engineers · PhD required

  4. Research Engineer (Agentic Models) ↗

    JetBrains (Junie, Mellum) · Research scientists and engineers · No degree stated

  5. Staff Research Engineer (LLM Pre-Training) ↗

    JetBrains (Junie, Mellum) · Research scientists and engineers · No degree stated

  6. AI Research Engineer, Post-Training ↗

    Lovable · Research scientists and engineers · No degree stated

  7. Machine Learning Scientist ↗

    Relace · Research scientists and engineers · Master's, PhD or equivalent

  8. Software Engineer, Distributed Systems ↗

    Thinking Machines Lab · ML systems and infrastructure · No degree stated · $300k to $350k base

  9. Research Scientist, Robotics ↗

    Allen Institute for AI (Ai2) · Research scientists and engineers · PhD required · $167k to $261k base

  10. Performance Engineer, GPU ↗

    Anthropic · ML systems and infrastructure · No degree stated · $280k to $850k base

  11. Research Engineer / Research Scientist, RL Frontiers ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  12. Research Engineer / Research Scientist, Tokens ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $500k base

  13. Research Engineer, Code RL (Reinforcement Learning) ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  14. Research Engineer, Discovery ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  15. Research Engineer, Machine Learning (RL Velocity) ↗

    Anthropic · Research scientists and engineers · No degree stated

  16. Research Engineer, Machine Learning (RL Velocity) ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  17. Research Engineer, Pretraining ↗

    Anthropic · Research scientists and engineers · Master's or PhD required

  18. Research Engineer, RL Engineering ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  19. Research Engineer/Research Scientist, Pre-training ↗

    Anthropic · Research scientists and engineers · Master's or PhD required · $350k to $850k base

  20. Staff Research Engineer, Discovery Team ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  21. Staff Software Engineer, Infrastructure (Distributed Systems) ↗

    Anthropic · ML systems and infrastructure · No degree stated

  22. Staff+ Software Engineer, Infrastructure (Distributed Systems) ↗

    Anthropic · ML systems and infrastructure · No degree stated · $320k to $485k base

  23. Applied Researcher, Audio ↗

    Cartesia · Research scientists and engineers · No degree stated · $200k to $350k base

  24. Principal Research Engineer, Post-Training ↗

    Character.AI · Research scientists and engineers · PhD or equivalent experience · $275k to $400k base

  25. Audio Inference Engineer, Model Efficiency ↗

    Cohere · ML systems and infrastructure · No degree stated

  26. Machine Learning Intern/Co-op (Winter 2027) ↗

    Cohere · Fellowships, residencies and internships · No degree stated

  27. Member of Technical Staff, Data Analysis and Evaluation ↗

    Cohere · Research scientists and engineers · No degree stated

  28. Member of Technical Staff, Integration/RL Team (Research Engineer) ↗

    Cohere · Research scientists and engineers · No degree stated

  29. Member of Technical Staff, Modeling ↗

    Cohere · Research scientists and engineers · No degree stated

  30. Member of Technical Staff, Post-Training ↗

    Cohere · Research scientists and engineers · No degree stated

  31. Member of Technical Staff, Training Infra Engineer ↗

    Cohere · ML systems and infrastructure · No degree stated

  32. Member of Technical Staff, Training Performance Engineer ↗

    Cohere · ML systems and infrastructure · No degree stated

  33. Research Internship (Winter 2027) ↗

    Cohere · Fellowships, residencies and internships · PhD required

  34. Senior Member of Technical Staff, Multimodal AI ↗

    Cohere · Research scientists and engineers · No degree stated

  35. Senior Member of Technical Staff, Safety and Security for Agents ↗

    Cohere · Research scientists and engineers · No degree stated

  36. Senior ML Systems Engineer, Frameworks & Tooling ↗

    Cohere · ML systems and infrastructure · No degree stated

  37. Senior Software Engineer, GPU Infrastructure (HPC) ↗

    Cohere · ML systems and infrastructure · No degree stated

  38. Research Scientist, Robotics RL, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD or equivalent experience

  39. Software Engineer, Model Inference, DeepMind ↗

    Google DeepMind · ML systems and infrastructure · Bachelor's or equivalent

  40. Research Engineer / Scientist, Post-training - Paris ↗

    H Company · Research scientists and engineers · Master's or PhD required

  41. Research Engineer, Training & Inference ↗

    Harmonic · Research scientists and engineers · PhD preferred · $200k to $450k base

  42. Principal Research Engineer, Model Training & Post-Training ↗

    Inflection AI · Research scientists and engineers · PhD or equivalent experience · $400k to $550k base

  43. ML Research Engineer, London ↗

    Isomorphic Labs · Research scientists and engineers · Master's, PhD or equivalent

  44. Research Engineer (LLM Performance), London ↗

    Isomorphic Labs · Research scientists and engineers · No degree stated

  45. Member of Technical Staff - Distributed Training Engineer ↗

    Liquid AI · ML systems and infrastructure · No degree stated

  46. Member of Technical Staff - GPU Infrastructure Engineer ↗

    Liquid AI · ML systems and infrastructure · No degree stated

  47. Member of Technical Staff - Multi-Modal, Audio ↗

    Liquid AI · Research scientists and engineers · No degree stated

  48. Research Scientist - World Model ↗

    Luma AI · Research scientists and engineers · PhD or equivalent experience

  49. Research Scientist / Engineer – Performance Optimization ↗

    Luma AI · Research scientists and engineers · No degree stated

  50. Research Scientist / Engineer – Reinforcement Learning ↗

    Luma AI · Research scientists and engineers · No degree stated

  51. Research Scientist / Engineer – Training Infrastructure ↗

    Luma AI · Research scientists and engineers · No degree stated

  52. Research Scientist / Engineer — Foundation Model (Agent) ↗

    Luma AI · Research scientists and engineers · No degree stated

  53. Member of Technical Staff, Kernels ↗

    Magic · ML systems and infrastructure · No degree stated · $275k to $550k base

  54. AI Research Assistant (PhD) ↗

    Meta (Superintelligence Labs and FAIR) · Fellowships, residencies and internships · PhD required

  55. Research Engineer, Safety Evaluation ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD required

  56. Research Scientist, AI & Systems Co-Design (PhD) ↗

    Meta (Superintelligence Labs and FAIR) · Fellowships, residencies and internships · PhD required

  57. Research Scientist, Artificial Intelligence ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD or equivalent experience