Skip to content

Skills · Train models

Pretraining and scaling laws

Course coming soon

Data mixtures, compute budgets and the curves that predict loss before the big run.

Mentioned in 73 of 339 recorded research roles (22%) and 101 of 1,827 technical roles (6%), in this recorded board.

Learn it here

The course page has its planned syllabus and a sign-up, which tells us how many people want it.

Explore opportunities

Everything here that teaches it

Nothing on this site teaches it yet. It is listed so you can see how often labs ask for it, and the course in preparation above has a sign-up.

Also in Train models: How language models work, Post-training and fine-tuning, Reinforcement learning, RL environments and verifiers, Interpretability, Alignment research, Multimodal models.

Who asks for it

Recorded roles that mention it

101 recorded postings mention it. Here are the newest 60 research, fellowship, applied and ML-systems roles; the rest are on the role pages linked above. Each title opens the lab's own posting.

  1. Staff Research Engineer, Multi-Agent Scaling ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  2. Research Engineer, Mid-Training ↗

    Cognition · Research scientists and engineers · PhD required

  3. Staff Research Engineer (LLM Pre-Training) ↗

    JetBrains (Junie, Mellum) · Research scientists and engineers · No degree stated

  4. Research Engineer / Research Scientist, RL Frontiers ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  5. Research Engineer, Interpretability ↗

    Anthropic · Research scientists and engineers · No degree stated · $315k to $560k base

  6. Research Engineer, Machine Learning (RL Velocity) ↗

    Anthropic · Research scientists and engineers · No degree stated

  7. Research Engineer, Machine Learning (RL Velocity) ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  8. Research Engineer, Pretraining ↗

    Anthropic · Research scientists and engineers · Master's or PhD required

  9. Research Engineer, Pretraining Scaling ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  10. Research Engineer, Pretraining Scaling - London ↗

    Anthropic · Research scientists and engineers · No degree stated

  11. Research Engineer, RL Engineering ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  12. Research Engineer, Visual Knowledge Work ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  13. Research Engineer/Research Scientist, Pre-training ↗

    Anthropic · Research scientists and engineers · Master's or PhD required · $350k to $850k base

  14. Research Scientist, Interpretability ↗

    Anthropic · Research scientists and engineers · No degree stated · $350k to $850k base

  15. Applied Researcher, Audio ↗

    Cartesia · Research scientists and engineers · No degree stated · $200k to $350k base

  16. Research Engineer, Data Infrastructure (Language Modeling) ↗

    Cartesia · Research scientists and engineers · No degree stated · $200k to $350k base

  17. Member of Technical Staff, Pre-Training Data ↗

    Cohere · Research scientists and engineers · No degree stated

  18. Member of Technical Staff, Training Performance Engineer ↗

    Cohere · ML systems and infrastructure · No degree stated

  19. Senior Member of Technical Staff, Synthetic Data ↗

    Cohere · Research scientists and engineers · No degree stated

  20. Senior Member of Technical Staff, Web Data ↗

    Cohere · Research scientists and engineers · No degree stated

  21. Research Engineer, Cyber Gemini, DeepMind ↗

    Google DeepMind · Research scientists and engineers · Bachelor's or equivalent

  22. Research Engineer, World Models, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD preferred

  23. Research Scientist, Gemini Vision, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD or equivalent experience

  24. Research Scientist, Multilingual, Multicultural and Multimodal LLM, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD or equivalent experience

  25. Research Scientist, Reasoning and Artificial General Intelligence, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD or equivalent experience

  26. Research Scientist, Robotics Pre-Training and Data Quality, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD or equivalent experience

  27. Member of Technical Staff - ML Research Engineer, Data ↗

    Liquid AI · Research scientists and engineers · PhD required

  28. Member of Technical Staff - ML Scientist, Japanese Multimodal ↗

    Liquid AI · Research scientists and engineers · No degree stated

  29. Member of Technical Staff, Inference & RL Systems ↗

    Magic · Research scientists and engineers · No degree stated · $275k to $550k base

  30. Member of Technical Staff, Kernels ↗

    Magic · ML systems and infrastructure · No degree stated · $275k to $550k base

  31. Member of Technical Staff, RL Research & Environments ↗

    Magic · Research scientists and engineers · No degree stated · $275k to $550k base

  32. Research Engineer ↗

    Magic · Research scientists and engineers · No degree stated · $275k to $550k base

  33. Research Engineer, Pre-training Data - MSL FAIR ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · Master's or PhD required

  34. Research Engineer, Privacy Evals - Meta Superintelligence Labs ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · Master's, PhD or equivalent

  35. Research Scientist, Multi-Modal Human Understanding ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · Bachelor's or equivalent

  36. AI Scientist - Agentic Engineering ↗

    Mistral AI · Research scientists and engineers · No degree stated

  37. AI Scientist - Physics Models ↗

    Mistral AI · Research scientists and engineers · Master's or PhD required

  38. Applied Science - Research Engineer (Robotics) ↗

    Mistral AI · Research scientists and engineers · PhD preferred

  39. Applied Scientist ↗

    Mistral AI · Research scientists and engineers · PhD preferred

  40. Applied Scientist (Internship) ↗

    Mistral AI · Fellowships, residencies and internships · PhD preferred

  41. Applied Scientist (Internship in Paris or London) ↗

    Mistral AI · Fellowships, residencies and internships · PhD preferred

  42. Applied Scientist, EMEA ↗

    Mistral AI · Research scientists and engineers · PhD preferred

  43. Applied Scientist, South Korea ↗

    Mistral AI · Research scientists and engineers · PhD preferred

  44. Lead Applied Scientist, South Korea ↗

    Mistral AI · Research scientists and engineers · PhD preferred

  45. Research Engineer, Machine Learning ↗

    Mistral AI · Research scientists and engineers · Master's, PhD or equivalent

  46. Agent Post-Training Research ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  47. Agent Post-Training, Artifacts Research ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  48. Agent Post-Training, Computer Use Research ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  49. Agent Post-Training, Connectors Research ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  50. Agent Post-Training, Context Research ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  51. Research Engineer / Research Scientist, Health ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  52. Research Engineer, Codex ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  53. Researcher, Agent Safety, Training and Evaluations ↗

    OpenAI · Research scientists and engineers · No degree stated · $380k to $500k base

  54. Researcher, Alignment CoT Monitorability ↗

    OpenAI · Research scientists and engineers · No degree stated · $295k to $500k base

  55. Training Performance Engineer ↗

    OpenAI · ML systems and infrastructure · No degree stated · $295k to $500k base