Software Engineer II

Who you are

You have a solid foundation in software engineering principles, with experience in developing high-performance systems that operate at scale. Your background includes proficiency in C and C++, allowing you to design and implement low-level runtime features effectively. You are comfortable working in a Linux environment and have a good understanding of system-level programming. Your experience with Python enables you to develop scripts and tools that enhance system functionality and performance. You are familiar with REST API design and implementation, which is crucial for integrating various components of the system. You thrive in collaborative environments, working closely with hardware teams and other software engineers to deliver robust solutions. You are eager to learn and adapt to new technologies, particularly in the rapidly evolving field of AI infrastructure.

Desirable

Experience with PCIe transport paths and memory management would be a plus, as it aligns with the responsibilities of the role. Familiarity with cloud-scale deployment and orchestration of data across multiple devices will help you excel in this position. A background in AI or machine learning systems can also be beneficial, as it will provide context for the challenges faced in this role.

What you'll do

As a Software Engineer II, you will play a key role in the development of the foundational software layers that power Microsoft's custom AI accelerator, the MAIA chip. You will design and implement low-level runtime features that facilitate efficient execution across multiple MAIA accelerators and host CPUs. Your responsibilities will include optimizing command stream encoding and ensuring effective PCIe transport paths. You will work on runtime coordination and low-level scheduling, focusing on optimizing for latency, bandwidth, and throughput. Collaborating with hardware teams, compiler teams, and observability partners will be essential to ensure that every byte moved is intentional and efficient. You will contribute to shaping the AI infrastructure layer, helping to redefine how data is moved and synchronized across accelerators. Your work will directly impact the performance and scalability of AI models deployed in the cloud.

What we offer

At Microsoft, you will be part of a collaborative and innovative team that is at the forefront of AI technology. We offer a competitive salary and benefits package, including opportunities for professional growth and development. You will have access to cutting-edge tools and technologies, allowing you to expand your skill set and make a significant impact in the field of AI infrastructure. Our culture encourages diversity and inclusion, and we believe that diverse teams build better products. We support work-life balance and provide flexible working arrangements to help you thrive both personally and professionally.