Sr. Staff Software Engineer - Metadata Intelligence

Who you are

You have 5+ years of experience in software engineering, particularly in building scalable systems that handle complex data challenges. Your expertise in Java and Apache Spark allows you to design and implement robust solutions that enhance data governance and discovery. You are comfortable working with distributed systems and have a strong understanding of metadata management and lineage tracking.

You possess a strategic mindset, capable of defining the vision and architecture for innovative products. Your leadership skills enable you to guide teams effectively, fostering collaboration and driving key initiatives that align with business goals. You are passionate about empowering developers and enhancing user experiences through intelligent data solutions.

You have a proven track record of delivering high-quality software and are adept at navigating the complexities of data and AI infrastructure. Your analytical skills help you identify opportunities for improvement and innovation within existing systems, ensuring that your contributions have a lasting impact.

Desirable

Experience with cloud platforms such as AWS or Azure is a plus, as is familiarity with governance frameworks and compliance standards. You may also have exposure to machine learning models and their integration into data platforms, enhancing your ability to contribute to the team’s objectives.

What you'll do

In this role, you will lead the development of the Unity Catalog, a unified governance solution for data and AI. You will define the architecture and strategy for capturing and inferring metadata, improving data understanding across the organization. Your work will involve building distributed systems that track data lineage and ensure compliance with governance policies.

You will collaborate closely with cross-functional teams, including data scientists and product managers, to deliver solutions that enhance productivity and user experience. Your initiatives will focus on creating intelligent search capabilities and automated insights that empower users to make data-driven decisions.

As a Senior Staff Software Engineer, you will mentor junior engineers, sharing your knowledge and expertise to foster their growth. You will also participate in code reviews and contribute to the overall technical direction of the team, ensuring that best practices are followed and that the team remains aligned with industry standards.

What we offer

At Databricks, you will be part of a mission-driven company that is transforming the way organizations leverage data and AI. We offer a collaborative work environment where innovation is encouraged, and your contributions will directly impact our customers' success. You will have access to professional development opportunities and the chance to work with cutting-edge technologies in the data and AI space. Join us in shaping the future of data infrastructure and governance.