Senior ML Engineer (Token Factory)

Who you are

You have 5+ years of experience in machine learning engineering, with a strong focus on distributed systems and large language models. Your expertise includes enhancing fine-tuning methodologies, particularly with LoRA-based and full-parameter approaches, ensuring both model quality and training efficiency. You are proficient in Python and have hands-on experience with frameworks like TensorFlow and PyTorch, which you have used to build and optimize machine learning models at scale.

You are familiar with advanced inference optimization techniques such as speculative decoding and quantization, and you understand the intricacies of large-scale draft model training. Your background includes working with cloud computing environments, and you are comfortable deploying models using containerization technologies like Docker and orchestration tools like Kubernetes. You thrive in collaborative settings, working closely with cross-functional teams to drive innovation and solve complex problems.

Desirable

Experience with GPU cloud infrastructure is a plus, as is familiarity with the latest advancements in AI and machine learning technologies. You are a proactive learner, always seeking to stay updated with industry trends and best practices. Your communication skills enable you to articulate complex concepts clearly to both technical and non-technical stakeholders.

What you'll do

In this role, you will be part of the Token Factory team at Nebius AI, contributing to the development of an inference and fine-tuning platform that supports various foundation models, including text, vision, and audio. You will enhance fine-tuning methodologies for cutting-edge LLMs, focusing on improving model performance and training efficiency. Your responsibilities will include researching and implementing advanced inference optimization techniques to ensure that models are fast, reliable, and easy to deploy at scale.

You will collaborate with a team of experienced engineers and researchers, sharing insights and best practices to foster a culture of innovation. Your work will directly impact the capabilities of Nebius Cloud, one of the largest GPU clouds in the world, enabling customers to leverage AI technologies without the need for extensive in-house teams.

What we offer

Nebius AI provides a competitive salary and a comprehensive benefits package, along with opportunities for professional growth within the company. You will enjoy flexible working arrangements, allowing you to balance your professional and personal life effectively. Our dynamic and collaborative work environment values initiative and innovation, and we encourage you to apply even if your experience doesn't match every requirement. Join us in shaping the future of AI and cloud computing.