Technical Product Manager (Cluster Experience)

The role

We're building the leading platform for large-scale Machine Learning (ML) training and inference — powering workloads from a few nodes to thousands of GPUs. We're looking for a Product Manager who will define how customers experience GPU clusters: their reliability, performance, and overall usability at scale. As a Product Manager in the Cluster Experience team, you will own foundational tracks that shape how ML teams train and serve models on multi-node distributed systems. Your initial focus will be reliability, performance, and observability for large-scale training and distributed inference. Over time, the role expands into UX, operational tooling, and advanced cluster workflows. This is a deeply technical PM role, but it does not require prior product management experience - strong candidates with backgrounds in ML infrastructure, distributed systems, SRE, or cloud engineering who want to grow into product are welcome. If you want to influence how state-of-the-art models are trained and deployed at scale, this role is for you.

Your responsibilities will include: 

• Own key tracks in Cluster Experience: reliability, performance, and user experience for distributed ML workloads.
• Define product direction from problem discovery → design → delivery → adoption, working closely with engineering and research teams.
• Drive cross-functional execution across compute, networking, storage, observability, and platform teams.
• Perform deep customer research: interviews, analytics, and workload studies to identify bottlenecks across hardware, network, scheduler, and runtime.
• Translate state-of-the-art ML papers ideas into practical, scalable product features for large GPU clusters.
• Shape how users interact with clusters - from dashboards and notifications to partitioning, node management, and training observability.  

We expect you to have: 

• 3–5+ years of experience in product management, ML infrastructure/MLOps, distributed systems engineering, or cloud architecture.
• Strong technical foundation in computer science, distributed systems, or ML infrastructure.
• Hands-on familiarity with ML training, ideally using orchestrators like Slurm, Kubernetes, Ray, or similar systems.
• Proven ability to ship technically complex features with multiple engineering teams.
• Excellent communicator capable of influencing engineering, research, and customer stakeholders.
• Experience with product analytics, data-driven prioritization, and experiment design.
• Strong willingness and ability to learn quickly in a fast-evolving ML and infrastructure environment.

It will be an added bonus if you have: 

• Experience working with GPU platforms, Infiniband/RDMA networking, or HPC systems.
• Understanding of modern ML frameworks (PyTorch, DeepSpeed, FSDP, NCCL, etc.).
• Knowledge of ML training efficiency: Goodput, MFU, scheduling, health checks.
• Exposure to LLM training, distributed data/ZeRO/FSDP strategies, or transformer inference.
• Experience in observability, performance tuning, or reliability engineering.
• Customer-facing technical experience (supporting ML or infrastructure workloads).

About Nebius

Nebius AI is an AI cloud platform with one of the largest GPU capacities in Europe. Launched in November 2023, the Nebius AI platform provides high-end, training-optimized infrastructure for AI practitioners. As an NVIDIA preferred cloud service provider, Nebius AI offers a variety of NVIDIA GPUs for training and inference, as well as a set of tools for efficient multi-node training. 

Nebius AI owns a data center in Finland, built from the ground up by the company’s R&D team and showcasing our commitment to sustainability. The data center is home to ISEG, the most powerful commercially available supercomputer in Europe and the 16th most powerful globally (Top 500 list, November 2023).  

Nebius’s headquarters are in Amsterdam, Netherlands, with teams working out of R&D hubs across Europe and the Middle East. 

Nebius AI is built with the talent of more than 500 highly skilled engineers with a proven track record in developing sophisticated cloud and ML solutions and designing cutting-edge hardware. This allows all the layers of the Nebius AI cloud – from hardware to UI – to be built in-house, distictly differentiating Nebius AI from the majority of specialized clouds: Nebius customers get a true hyperscaler-cloud experience tailored for AI practitioners. We’re growing and expanding our products every day. 

If you’re up to the challenge and are excited about AI and ML as much as we are, join us!