Lead Data Engineer

Who you are

You have extensive experience in data engineering, with a strong background in developing modern data architectures that meet business objectives. You are skilled in creating intricate data processing pipelines and have a deep understanding of how to leverage data to solve complex problems. Your hands-on coding experience is complemented by your ability to lead teams and manage projects from inception to completion. You are proficient in using various distributed storage and computing technologies, and you understand the importance of data quality in delivering impactful solutions.

You are a collaborative leader who enjoys working with stakeholders to identify opportunities for leveraging data. You have experience in designing and implementing scalable data solutions, and you are comfortable guiding clients through technical reviews and organizational assessments. Your coding practices are rooted in test-driven development (TDD), and you are familiar with continuous delivery practices to ensure the smooth operation of data pipelines.

Desirable

Experience with cloud platforms such as AWS or Azure is a plus, as is familiarity with containerization technologies like Docker. You may also have experience working alongside data scientists to implement machine learning models and optimize data workflows. Your ability to communicate complex technical concepts to non-technical stakeholders will set you apart.

What you'll do

In this role, you will lead data engineering projects, collaborating with cross-functional teams to define project goals and scope. You will oversee the design and implementation of data solutions that align with client objectives, ensuring timely delivery and high-quality outcomes. Your responsibilities will include creating and managing data processing pipelines, as well as advising clients on best practices for data architecture and technology selection.

You will work closely with data scientists to translate their models into scalable implementations, ensuring that data quality and integrity are maintained throughout the process. Your leadership will guide your team in adopting best practices for coding and deployment, fostering a culture of continuous improvement and innovation.

You will also engage in deep technical reviews with clients, helping them understand the potential of their data and how it can be harnessed to address their most pressing challenges. Your role will require you to stay updated on industry trends and emerging technologies, allowing you to provide informed recommendations to clients and your team.

What we offer

At ThoughtWorks, we believe in pushing boundaries through impactful work. You will be part of a collaborative environment that values continuous learning and professional growth. We offer competitive compensation and benefits, along with opportunities to work on diverse projects that make a difference. Join us in our mission to help clients solve complex business problems with technology as the differentiator.