Data Platform Engineer, Data Capture

Who you are

You have a solid background in data engineering with at least 3 years of experience in building and maintaining data pipelines — you've successfully implemented solutions that improve data accessibility and quality for analytics and machine learning teams. Your expertise in Python and SQL allows you to manipulate and analyze large datasets effectively, ensuring that data is both reliable and actionable.

You are familiar with cloud platforms, particularly AWS, and understand how to leverage services like S3, Redshift, and Lambda to create scalable data solutions. Your experience with Apache Airflow or similar orchestration tools means you can design and manage complex workflows that automate data processing tasks.

You possess strong problem-solving skills and can troubleshoot data issues efficiently — you enjoy diving deep into data discrepancies and finding the root cause of problems. Your collaborative nature allows you to work effectively with cross-functional teams, including data analysts and software engineers, to deliver high-quality data solutions.

You are committed to continuous learning and staying updated with the latest trends in data engineering and cloud technologies — you actively seek out opportunities to enhance your skills and share knowledge with your team. You understand the importance of documentation and maintain clear records of your work to facilitate knowledge transfer within the team.

Desirable

Experience with data visualization tools like Tableau or Looker is a plus, as it helps you communicate insights effectively to stakeholders. Familiarity with machine learning concepts can also be beneficial, as you may collaborate with ML scientists to provide them with the data they need for model training.

What you'll do

As a Data Platform Engineer at Upstart, you will play a crucial role in expanding the developer tools that capture business events and operational data — your work will directly impact the efficiency and effectiveness of data access across the organization. You will design and implement data pipelines that ensure high-quality data is available for analysis and reporting.

You will collaborate closely with data analysts and software engineers to understand their data needs and develop solutions that meet those requirements — this may involve building new data ingestion processes or optimizing existing ones to improve performance and reliability. Your expertise in AWS will be essential as you leverage cloud services to create scalable and cost-effective data solutions.

You will also be responsible for monitoring data pipelines and ensuring they run smoothly — this includes setting up alerts for failures and troubleshooting issues as they arise. Your proactive approach will help maintain the integrity of the data and minimize downtime.

In addition to technical responsibilities, you will participate in team meetings and contribute to discussions about data strategy and best practices — your insights will help shape the direction of the data engineering team and ensure alignment with Upstart's overall mission of expanding access to affordable credit.

What we offer

At Upstart, we foster a culture of innovation and collaboration — you will have the opportunity to work with a talented team of professionals who are passionate about leveraging technology to make a positive impact in the lending industry. We offer competitive compensation and benefits, including flexible work arrangements that allow you to thrive in a remote environment.

You will also have access to professional development resources to help you grow your skills and advance your career — we encourage you to take advantage of training opportunities and attend industry conferences to stay at the forefront of data engineering practices. Join us in our mission to transform the lending landscape and make credit more accessible for everyone.