Research Engineer, Frontier Speculative Decoding

Who you are

You have a strong background in AI research and engineering, with experience in developing and deploying machine learning models. Your expertise in Python and familiarity with frameworks like TensorFlow and PyTorch enable you to create efficient, specialized models that meet customer needs. You understand the importance of data-centric development and are committed to meticulous hyperparameter tuning and rigorous evaluation processes. You thrive in collaborative environments, working closely with customers and cross-functional teams to ensure that your models deliver real business value. You are detail-oriented and have a passion for pushing the boundaries of accuracy and efficiency in AI applications.

Desirable

Experience with generative AI models and a solid understanding of the underlying algorithms will set you apart. Familiarity with GPU clusters and high-performance computing environments is a plus, as is a background in data engineering. You are comfortable working in fast-paced settings and can adapt to evolving project requirements while maintaining a focus on quality and performance.

What you'll do

In this role, you will design and iterate on novel speculative algorithms that combine architectural innovations with carefully curated data. You will be the critical link between raw data and production-ready models, ensuring that your work directly impacts customer success. Collaborating with a team of experts, you will tackle high-performance challenges in generative AI, transforming general-purpose models into specialized tools. You will engage with customers to understand their specific needs and fine-tune models based on both internal data recipes and proprietary datasets. Your responsibilities will include conducting rigorous evaluations of model performance and iterating on designs to achieve optimal results. You will also work closely with the core inference and applied ML research teams to integrate your work into production environments, ensuring seamless deployment and functionality.

What we offer

Together AI offers a dynamic work environment where innovation is at the forefront. You will have the opportunity to work on cutting-edge technology that shapes the future of generative AI. We provide competitive compensation and benefits, fostering a culture of collaboration and continuous learning. You will be part of a mission-driven team dedicated to solving real-world challenges through advanced AI solutions. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds.