Lead Data Engineer

Who you are

You have 5+ years of experience in data engineering, with a strong background in developing data architecture that meets business objectives. You are skilled in Python and SQL, and you understand how to leverage cloud technologies like AWS to build scalable data solutions. You have experience with data processing frameworks such as Apache Spark and are familiar with orchestration tools like Airflow. You are a natural leader, capable of guiding teams through complex projects while ensuring high-quality deliverables. You are comfortable collaborating with stakeholders to identify data opportunities and understand their strategic objectives. You write clean, maintainable code and are committed to best practices in software development, including test-driven development (TDD). You thrive in environments where you can push boundaries and innovate with data.

Desirable

Experience with Docker and other containerization technologies is a plus. Familiarity with data visualization tools and methodologies will enhance your ability to communicate insights effectively. You are open to continuous learning and adapting to new technologies as they emerge in the data landscape.

What you'll do

As a Lead Data Engineer at ThoughtWorks, you will manage data engineering projects from inception to completion, ensuring that they align with client goals and are delivered on time. You will lead the design and implementation of data processing pipelines, addressing complex challenges that clients face. Your role will involve collaborating closely with data scientists to ensure that their models are implemented effectively and can scale as needed. You will also be responsible for conducting technical reviews and advising clients on the best practices for utilizing distributed storage and computing technologies. Your hands-on coding will be complemented by your leadership in guiding the team through the development process, ensuring that everyone is aligned and working towards common objectives. You will leverage your expertise to create innovative solutions that drive business value through data.

What we offer

At ThoughtWorks, we foster a culture of collaboration and continuous improvement. You will have the opportunity to work on impactful projects that challenge you and allow you to grow your skills. We offer a supportive environment where your contributions are valued, and you can make a real difference in the way organizations leverage data. Join us in pushing the boundaries of what is possible with technology and data, and help our clients solve their most pressing problems.