Staff Software Engineer (Architect) , Spark

Who you are

You have over 10 years of experience building large-scale distributed software systems — you've tackled complex challenges and have a deep understanding of system architecture and performance optimization. Your solid understanding of Java for backend and systems software development enables you to write efficient and maintainable code that meets high-performance standards.

You are familiar with Apache Spark internals and have a passion for improving data processing capabilities — your experience allows you to dramatically enhance Spark job performance for various use cases. You thrive in collaborative environments, working closely with data science and engineering teams to drive improvements and innovations.

Your educational background includes a Bachelor’s degree in Computer Science or a related field, and you may also hold advanced degrees such as a BTech, MS, or PhD. You are committed to contributing to the open-source community and have experience in upstreaming contributions while maintaining internal forks of software.

Desirable

Experience with distributed algorithms and batch data processing is a plus, as is familiarity with cross-functional collaboration in large organizations. You are open to learning and adapting to new technologies and methodologies that can enhance your work and the team's output.

What you'll do

As a Staff Software Engineer on the Spark team at Uber, you will design, implement, optimize, and manage large-scale distributed computing infrastructure that impacts multiple business use cases. You will collaborate with Uber's data science and engineering teams to improve Spark applications and use cases, leveraging your knowledge of Spark internals to enhance job performance.

You will be responsible for designing and implementing distributed algorithms for large-scale batch data processing, ensuring that the infrastructure is robust and efficient. Your role will involve working with multiple partner teams both within and outside of Uber to build cross-functional solutions in a collaborative work environment.

You will also have the opportunity to contribute to the open-source community for Spark and related domains, helping to upstream Uber's contributions while keeping the internal fork up to date. Your work will directly impact the performance and reliability of Spark at Uber, which is used by thousands of active users weekly.

What we offer

At Uber, you will be part of a dynamic team that values innovation and collaboration. We offer a competitive salary and benefits package, along with opportunities for professional growth and development. You will work in an environment that encourages you to share your ideas and contribute to meaningful projects that have a real impact on the business.

We believe in fostering a culture of inclusivity and support, where every team member can thrive. Join us in shaping the future of data processing at Uber and making a difference in the world of big data analytics.