Staff Backline Engineer (Spark)

Who you are

You have extensive experience in backend engineering, particularly with Apache Spark, and a strong understanding of its core internals. You are adept at troubleshooting complex technical issues and can provide deep code-level analysis to resolve customer escalations effectively. Your background includes working closely with support teams to ensure that all issues are thoroughly vetted before reaching engineering. You are skilled in providing best practices guidance around Spark runtime performance and the usage of Spark core libraries and APIs for custom-built solutions.

You possess excellent communication skills, allowing you to act as a technical bridge between support and engineering teams. You are proactive in identifying potential issues and suggesting improvements to existing processes. Your experience includes contributing to automation and tooling programs that enhance daily troubleshooting efficiency. You are familiar with the latest features and releases from the Spark Engineering Team and can effectively communicate these to both customers and support staff.

Desirable

Experience with Databricks' Data Intelligence platform is a plus, as is familiarity with machine learning concepts and practices. You have a passion for helping customers succeed and a commitment to continuous learning in the rapidly evolving field of data analytics.

What you'll do

In this role, you will be responsible for troubleshooting and resolving complex customer issues related to Apache Spark and the Databricks platform. You will provide detailed troubleshooting guides and runbooks to assist the support team in their efforts. Your role will involve conducting deep code-level analysis of Spark to address customer escalations effectively. You will also contribute to the development of automation tools that streamline troubleshooting processes, ensuring that the support team can operate efficiently.

You will collaborate closely with the Spark Engineering Team to stay informed about upcoming features and releases, ensuring that you can provide accurate and timely information to customers. Your insights will help shape the support processes and improve overall customer satisfaction. You will be expected to identify Spark bugs and suggest possible solutions, contributing to the continuous improvement of the Databricks platform.

What we offer

At Databricks, you will be part of a mission-driven company that is at the forefront of Unified Data Analytics. We offer a collaborative work environment where your contributions will directly impact our customers' success. You will have opportunities for professional growth and development, working alongside some of the brightest minds in the industry. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse perspectives and backgrounds.