Skip to content

Skills · Make it fast and big

GPU kernels

Course coming soon

CUDA and Triton: writing, profiling and speeding up the operations a model spends its time in.

Mentioned in 32 of 339 recorded research roles (9%) and 159 of 1,827 technical roles (9%), in this recorded board.

Learn it here

The course page has its planned syllabus and a sign-up, which tells us how many people want it.

Explore opportunities

Everything here that teaches it

Nothing on this site teaches it yet. It is listed so you can see how often labs ask for it, and the course in preparation above has a sign-up.

Also in Make it fast and big: Inference and serving, PyTorch, JAX, Distributed training.

Who asks for it

Recorded roles that mention it

159 recorded postings mention it. Here are the newest 60 research, fellowship, applied and ML-systems roles; the rest are on the role pages linked above. Each title opens the lab's own posting.

  1. Research Engineer, Inference Foundation ↗

    Mistral AI · Research scientists and engineers · No degree stated

  2. Research Engineer, ML Infrastructure ↗

    Cognition · Research scientists and engineers · PhD required

  3. Engineering Manager, Inference Infrastructure ↗

    Anthropic · ML systems and infrastructure · No degree stated · $405k to $625k base

  4. Performance Engineer ↗

    Anthropic · ML systems and infrastructure · No degree stated · $280k to $850k base

  5. Performance Engineer, GPU ↗

    Anthropic · ML systems and infrastructure · No degree stated · $280k to $850k base

  6. Performance Engineer, Inference Engine ↗

    Anthropic · ML systems and infrastructure · No degree stated · $350k to $850k base

  7. Performance Engineer, Inference Systems ↗

    Anthropic · ML systems and infrastructure · No degree stated · $350k to $850k base

  8. Research Engineer / Research Scientist, RL Frontiers ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  9. Research Engineer, Code RL (Reinforcement Learning) ↗

    Anthropic · Research scientists and engineers · No degree stated · $500k to $850k base

  10. Research Engineer, Interpretability ↗

    Anthropic · Research scientists and engineers · No degree stated · $315k to $560k base

  11. Staff Software Engineer, Infrastructure (Distributed Systems) ↗

    Anthropic · ML systems and infrastructure · No degree stated

  12. Staff+ Software Engineer, Inference Velocity ↗

    Anthropic · ML systems and infrastructure · No degree stated · $405k to $485k base

  13. Staff+ Software Engineer, Infrastructure (Distributed Systems) ↗

    Anthropic · ML systems and infrastructure · No degree stated · $320k to $485k base

  14. TPU Kernel Engineer ↗

    Anthropic · ML systems and infrastructure · No degree stated · $280k to $850k base

  15. Inference Engineer ↗

    Cartesia · ML systems and infrastructure · No degree stated · $180k to $250k base

  16. Machine Learning Infrastructure Engineer ↗

    Character.AI · ML systems and infrastructure · No degree stated · $150k to $350k base

  17. Audio Inference Engineer, Model Efficiency ↗

    Cohere · ML systems and infrastructure · No degree stated

  18. Machine Learning Intern/Co-op (Winter 2027) ↗

    Cohere · Fellowships, residencies and internships · No degree stated

  19. Member of Technical Staff, Model Efficiency ↗

    Cohere · Research scientists and engineers · No degree stated

  20. Member of Technical Staff, Modeling ↗

    Cohere · Research scientists and engineers · No degree stated

  21. Member of Technical Staff, Training Performance Engineer ↗

    Cohere · ML systems and infrastructure · No degree stated

  22. Senior Member of Technical Staff, Multimodal AI ↗

    Cohere · Research scientists and engineers · No degree stated

  23. Senior ML Systems Engineer, Frameworks & Tooling ↗

    Cohere · ML systems and infrastructure · No degree stated

  24. Research Engineer, World Models, DeepMind ↗

    Google DeepMind · Research scientists and engineers · PhD preferred

  25. Software Engineer, Model Inference, DeepMind ↗

    Google DeepMind · ML systems and infrastructure · Bachelor's or equivalent

  26. Staff Software Engineer, Inference Performance Optimization, GenAI, DeepMind ↗

    Google DeepMind · ML systems and infrastructure · Bachelor's or equivalent

  27. Research Engineer, Model Inference & Serving - London ↗

    H Company · Research scientists and engineers · Master's or PhD required

  28. Research Engineer, Model Inference & Serving - Paris ↗

    H Company · Research scientists and engineers · Master's or PhD required

  29. Research Engineer, Training & Inference ↗

    Harmonic · Research scientists and engineers · PhD preferred · $200k to $450k base

  30. ML Research Engineer, London ↗

    Isomorphic Labs · Research scientists and engineers · Master's, PhD or equivalent

  31. Research Engineer (LLM Performance), London ↗

    Isomorphic Labs · Research scientists and engineers · No degree stated

  32. Member of Technical Staff - GPU Performance Engineer ↗

    Liquid AI · ML systems and infrastructure · No degree stated

  33. Research Scientist / Engineer – Performance Optimization ↗

    Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base

  34. Research Scientist / Engineer – Training Infrastructure ↗

    Luma AI · Research scientists and engineers · No degree stated · $195k to $395k base

  35. Software Engineer, Inference ↗

    Luma AI · ML systems and infrastructure · No degree stated · $195k to $345k base

  36. Member of Technical Staff, Inference & RL Systems ↗

    Magic · Research scientists and engineers · No degree stated · $275k to $550k base

  37. Member of Technical Staff, Kernels ↗

    Magic · ML systems and infrastructure · No degree stated · $275k to $550k base

  38. Compiler Engineer, Graph Compiler Performance Optimization ↗

    Meta (Superintelligence Labs and FAIR) · ML systems and infrastructure · PhD or equivalent experience

  39. Research Scientist, AI & Systems Co-Design (PhD) ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD required

  40. Research Scientist, Artificial Intelligence ↗

    Meta (Superintelligence Labs and FAIR) · Research scientists and engineers · PhD or equivalent experience

  41. Software Engineer, AI Kernels & Performance Optimization — MTIA Software ↗

    Meta (Superintelligence Labs and FAIR) · ML systems and infrastructure · Master's, PhD or equivalent

  42. Software Engineer, Systems ML - Frameworks / Compilers / DL-Kernels ↗

    Meta (Superintelligence Labs and FAIR) · ML systems and infrastructure · PhD required

  43. Compute Solution Architect ↗

    Mistral AI · Applied AI and forward-deployed · No degree stated

  44. Research Engineer, Machine Learning ↗

    Mistral AI · Research scientists and engineers · Master's, PhD or equivalent

  45. Research Engineer, ML Platform ↗

    Mistral AI · Research scientists and engineers · No degree stated

  46. Research Software Engineer ↗

    Mistral AI · Research scientists and engineers · No degree stated

  47. Applied AI Engineer, Codex Core Agent ↗

    OpenAI · Applied AI and forward-deployed · No degree stated · $230k to $385k base

  48. Inference Engineer, Robotics ↗

    OpenAI · ML systems and infrastructure · No degree stated · $380k to $380k base

  49. Operating Systems Engineer, Linux Kernel | Consumer Devices ↗

    OpenAI · ML systems and infrastructure · No degree stated · $230k to $385k base

  50. Software Engineer, Accelerators ↗

    OpenAI · ML systems and infrastructure · No degree stated · $295k to $380k base

  51. Software Engineer, AI accelerator Runtime ↗

    OpenAI · ML systems and infrastructure · No degree stated · $266k to $445k base

  52. Software Engineer, GPU Infrastructure - HPC ↗

    OpenAI · ML systems and infrastructure · No degree stated · $230k to $490k base

  53. Software Engineer, Inference - Performance Optimization ↗

    OpenAI · ML systems and infrastructure · No degree stated · $266k to $500k base

  54. Software Engineer, Kernel Performance & AI Tooling ↗

    OpenAI · ML systems and infrastructure · No degree stated · $266k to $445k base

  55. Software Engineer, Model Inference ↗

    OpenAI · ML systems and infrastructure · No degree stated · $266k to $500k base

  56. Training Performance Engineer ↗

    OpenAI · ML systems and infrastructure · No degree stated · $295k to $500k base

  57. ML Systems Engineer ↗

    Periodic Labs · ML systems and infrastructure · No degree stated · $250k to $350k base

  58. ML Infra Engineer, Modeling ↗

    Physical Intelligence · ML systems and infrastructure · No degree stated

  59. Member of Technical Staff - Research Software Engineer ↗

    Reflection AI · Research scientists and engineers · PhD required

  60. Member of Technical Staff (GPU Performance Engineer) ↗

    Reka · ML systems and infrastructure · No degree stated