Machine Learning Engineer

Who you are

You have 5+ years of experience writing high-performance, well-tested, production-quality code — you've developed systems that are reliable and efficient, ensuring they meet the demands of large-scale applications. Your background includes a Bachelor’s degree in computer science or equivalent industry experience, providing you with a solid foundation in software development principles.

You are familiar with the LLM inference ecosystem, including frameworks and engines such as vLLM, SGLang, and TRT — your expertise allows you to implement runtime systems that perform inference at scale using AI/ML models. You have demonstrated experience in building large-scale, fault-tolerant, distributed systems, which is crucial for handling complex data processing tasks.

As an expert-level programmer, you are proficient in one or more of the following languages: Python, Go, Rust, or C/C++ — your coding skills enable you to create efficient algorithms and optimize existing code for performance. You have experience implementing runtime inference services at scale or similar, which has prepared you for the challenges of this role.

Desirable

Experience with cloud platforms and services is a plus, as it will enhance your ability to deploy and manage machine learning models in production environments. Familiarity with containerization technologies like Docker and orchestration tools such as Kubernetes will also be beneficial in this position.

What you'll do

In this role, you will design and build the production systems that power the Together Cloud inference and fine-tuning APIs — your work will enable reliability and performance at scale, directly impacting our customers' ability to leverage AI technologies. You will partner with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world, ensuring that our offerings remain at the forefront of innovation.

You will analyze and improve the efficiency, scalability, and stability of various system resources — your insights will help us optimize our infrastructure and enhance user experience. Conducting design and code reviews will be part of your responsibilities, as you ensure that our codebase maintains high standards of quality and performance.

Creating services, tools, and developer documentation will be essential for supporting your team and facilitating collaboration across departments. You will also create testing frameworks for robustness and fault-tolerance, ensuring that our systems can handle unexpected challenges without compromising performance.

Participating in an on-call rotation to respond to critical incidents as needed will be part of your role — your expertise will be crucial in maintaining system uptime and reliability. You will have the opportunity to contribute to a research-driven artificial intelligence company that values open and transparent AI systems, driving innovation in the industry.

What we offer

Together AI offers a collaborative and inclusive work environment where your contributions will have a meaningful impact. You will work alongside a talented team of professionals who are passionate about advancing AI technology and its applications. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds.

We provide competitive compensation and benefits, fostering a culture of growth and development. Join us in our mission to create innovative AI solutions that empower our customers and transform industries.