MTS - Data Engineering

• Build, maintain, and enhance data ETL pipelines for processing large-scale data with low latency and high throughput to support Copilot operations. 
• Design and maintain high throughput, low latency experimentation reporting pipelines that enable data scientists and product teams to measure model performance and user engagement. 
• Own data quality initiatives including monitoring, alerting, validation, and remediation processes to ensure data integrity across all downstream systems. 
• Implement robust schema management solutions that enable quick and seamless schema evolution without disrupting downstream consumers. 
• Develop and maintain data infrastructure that supports real-time and batch processing requirements for machine learning model training and inference. 
• Collaborate with ML engineers and data scientists to optimize data access patterns and improve pipeline performance for model evaluation workflows. 
• Design scalable data architectures that can handle growing data volumes and evolving business requirements. 
• Implement comprehensive monitoring and observability solutions for data pipelines, including SLA tracking and automated alerting. 
• Partner with cross-functional teams to understand data requirements and translate them into efficient technical solutions. 

Required Qualifications

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience.

Preferred Qualifications

• Experience building and maintaining production data pipelines at scale using technologies such as Apache Spark, Kafka, or similar distributed processing frameworks. 
• Experience writing production-quality Python, Scala, or Java code for data processing applications. 
• Experience building and scaling experimentation frameworks. 
• Experience with cloud data platforms (Azure, AWS, or GCP) and their data services. 
• Experience with schema management and data governance practices. 
• Experience with real-time data processing and streaming architectures. 
• Experience with data orchestration frameworks such as Airflow, Prefect, Dagster or similar workflow management systems.
• Experience with containerization technologies (Docker, Kubernetes) for data pipeline deployment. 
• Demonstrated experience with data quality frameworks and monitoring solutions. 

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.