Sr. Data Engineer

Who you are

You have 5+ years of experience as a Data Engineer, with a strong background in designing and implementing large-scale data pipelines. Your expertise includes working with both batch and streaming data, and you understand the intricacies of data modeling, particularly dimensional modeling. You treat data as a product, ensuring quality checks and observability are in place to maintain data integrity and trust among stakeholders.

You are proficient in using cloud platforms, particularly AWS, and have experience with tools like Apache and Airflow for orchestrating data workflows. Your programming skills in Python and SQL allow you to build robust data solutions that meet the needs of various teams within the organization. You are a collaborative team player, working closely with data scientists, software engineers, and finance partners to translate complex requirements into scalable data solutions.

Desirable

Experience with data governance, lineage, and metadata management is a plus, as is familiarity with data privacy regulations. You are comfortable implementing standard methodologies for data protection and privacy, aligning with organizational standards. Your ability to monitor and debug data pipelines ensures continuous improvement and reliability in data processing.

What you'll do

As a Senior Data Engineer on the Capacity Engineering team, you will architect, implement, and maintain data pipelines that process infrastructure telemetry and cost metrics. You will design data models that support analytics and internal billing, ensuring that data is accurate and timely for decision-making. Your role involves integrating raw signals with metadata to enhance data usability for various internal use cases.

You will collaborate with cross-functional teams to define requirements and deliver data solutions that are reliable and scalable. Your responsibilities will include implementing best practices for data quality, monitoring, and validation, as well as contributing to the overall data strategy of the organization. You will also be involved in building end-to-end data solutions that encompass logging, anomaly detection, and data transformation.

What we offer

Apple offers a dynamic work environment where you can contribute to impactful projects that drive efficiency and optimization across the company's infrastructure. You will have the opportunity to work with cutting-edge technologies and collaborate with talented professionals in a culture that values innovation and excellence. We encourage you to apply even if your experience doesn't match every requirement, as we believe diverse teams build better products.