Senior Data Engineer

Who you are

You have 5+ years of experience as a data engineer, with a strong background in building and maintaining data pipelines. You are comfortable working end-to-end, from data ingestion to reporting, and have a solid understanding of data modeling and analytics. Your expertise includes working with MySQL and BigQuery, and you are familiar with CDC ingestion using Google Cloud Datastream. You have experience designing and managing BigQuery tables, ensuring they are optimized for performance and cost efficiency. You are proficient in using dbt for building transformations and analytics models, and you understand the importance of proper partitioning and clustering in your data architecture.

You thrive in a collaborative environment and enjoy working closely with stakeholders to turn raw data into actionable insights. You are detail-oriented and have a knack for problem-solving, which allows you to tackle complex data challenges effectively. You are also committed to maintaining data quality and ensuring that the data foundation supports decision-making across various departments, including marketing, operations, and finance.

Desirable

Experience with orchestration tools for scheduling and managing data pipelines is a plus. Familiarity with other cloud platforms and data warehousing solutions can enhance your candidacy. You are open to learning new technologies and methodologies to improve data processes and outcomes.

What you'll do

In this role, you will be responsible for building and maintaining data pipelines that ingest data from MySQL and external sources into BigQuery. You will own the CDC ingestion process using Google Cloud Datastream and manage API or batch ingestion with dlt. Your work will involve designing and managing BigQuery tables with proper partitioning and clustering to ensure that queries are performant and cost-efficient. You will also build and maintain transformations and analytics models in dbt, utilizing staging, intermediate, and mart layers to facilitate data analysis.

You will collaborate with cross-functional teams to understand their data needs and provide insights that drive business decisions. Your role will require you to orchestrate scheduled and incremental pipelines, ensuring that data is up-to-date and accessible for reporting and analytics. You will also be involved in troubleshooting and optimizing existing data processes to enhance performance and reliability.

What we offer

Centerfield offers a dynamic work environment where you can make a significant impact on our data strategy. We provide opportunities for professional growth and development, allowing you to expand your skill set and advance your career. Our team is dedicated to fostering a culture of collaboration and innovation, where your contributions are valued and recognized. We encourage you to apply even if your experience doesn't match every requirement, as we believe in the potential of diverse backgrounds and perspectives.