About Microsoft
Empowering every person and organization on the planet
Key Highlights
- Market cap exceeds $2 trillion
- 100,000+ employees worldwide
- Leading cloud services through Azure
- Major clients include Walmart and BMW
Microsoft Corporation, headquartered in Redmond, Washington, is a leading technology company known for its software products like Windows and Office, as well as cloud services through Azure. With over 100,000 employees, Microsoft serves millions of customers globally, including major enterprises lik...
🎁 Benefits
Microsoft offers competitive salaries, stock options, generous PTO policies, and comprehensive health benefits. Employees also enjoy a flexible remote...
🌟 Culture
Microsoft fosters a culture of innovation and inclusivity, emphasizing collaboration across teams and a commitment to diversity. The company values em...
Software Engineer II
Microsoft • United States, Washington, Redmond
Skills & Technologies
Job Description
As an AI Engineer on the CoreAI Platform team, you will apply artificial intelligence to solve real, production‑critical problems across Microsoft’s AI systems. You will use AI/ML models, statistical modeling, intelligent automation to detect anomalies, identify emerging patterns, and predict system behaviors before they impact customers. Your work will drive reliability, performance, and efficiency across AI model-serving pipelines which power experience such as Copilot and Azure OpenAI Foundry models.
This is working at the intersection of C++ systems and AI model serving pipelines and your work will increase overall engineering velocity. We value engineers who think systemically, communicate clearly, and thrive in an ambiguous problem space.
Responsibilities
AI-Driven Problem Solving
Design, build, and scale AI models to detect anomalies, identify regressions across large-scale AI systems.
Analyze patterns in telemetry, logs, and real‑time signals to uncover root causes, predict failures, and drive proactive mitigations.
Apply AI to identify emerging usage trends, performance hotspots, and workload irregularities that impact system health and user experience.
Platform Coding
Build lightweight automation that leverages anomaly detection signals and pattern analysis to improve live‑site reliability and engineering velocity.
Contribute to hotfixes, performance tuning, and reliability improvements in production AI engines (e.g., GPU savings, SLA reliability, customer satisfaction).
Build intuitive, responsive UI components for AI dashboards and telemetry tools using React and modern web technologies.
Collaboration & Impact
Communicate technical concepts with clarity and initiative, proactively seeking feedback and driving continuous improvement.
Stay current with industry trends in applied AI, observability, and performance engineering.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- 2+ years of experience in Python for AI automation
- 1+ year(s) of experience in AI to build solutions using toolchains and frameworks in Python, C++ and Kubernetes (K8s)
- 1+ year(s) of experience demonstrating a grasp of Large Language Model (LLM) post-training techniques, inference optimization, and application-layer use cases
- Familiarity with embeddings, semantic search, or LLMbased analysis used for system intelligence or reasoning.
Familiarity with agentic frameworks (LangChain, Autogen, DSPy)
Exposure to React or frontend observability dashboards is a plus
Persuasive communication and collaboration abilities; comfortable working in ambiguous, fast-moving environments.
#CoreAI
#AIplatform
Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Interested in this role?
Apply now or save it for later. Get alerts for similar jobs at Microsoft.