Lead Data Engineer

Who you are

You have 5+ years of experience in data engineering, with a strong background in developing data architectures that meet business objectives. Your expertise in Python and SQL allows you to create intricate data processing pipelines that solve complex problems. You are familiar with cloud technologies, particularly AWS, and have experience with tools like Apache Spark and Airflow for data orchestration. You understand the importance of data quality and are skilled in collaborating with stakeholders to leverage data effectively. You are comfortable leading teams and projects, ensuring on-time delivery while fostering a collaborative environment.

Desirable

Experience with Docker for containerization and deployment of data solutions is a plus. Familiarity with data visualization tools and methodologies can enhance your contributions to the team. You are open to continuous learning and adapting to new technologies as they emerge in the data engineering landscape.

What you'll do

As a Lead Data Engineer at ThoughtWorks, you will manage data engineering projects from inception to completion, setting goals and defining scopes while ensuring timely delivery. You will collaborate closely with clients to understand their strategic objectives and identify opportunities to leverage data for impactful solutions. Your role will involve designing, developing, and operating modern data architectures that align with business needs. You will lead the implementation of data processing pipelines, working hands-on with code and guiding your team through the development process. You will also collaborate with data scientists to ensure scalable implementations of their models, contributing to the overall success of data-driven initiatives.

You will write clean, iterative code based on test-driven development (TDD) principles and leverage continuous delivery practices to deploy and support data pipelines. Your expertise will guide clients in utilizing various distributed storage and computing technologies, helping them navigate the complexities of data management. You will play a crucial role in pushing boundaries through impactful work, contributing to ThoughtWorks' mission of solving complex business problems with technology.

What we offer

At ThoughtWorks, we believe in the power of technology to drive change and make a difference. You will be part of a collaborative culture that values innovation and continuous improvement. We offer competitive compensation and opportunities for professional growth, encouraging you to expand your skills and expertise. Join us in our mission to deliver extraordinary impact together with our clients, and help shape the future of data engineering.