Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

About the Team

The Testing Tools & Infrastructure team within the Consumer Lifecycle Experiences Platform is crucial to our Commerce organization. It serves Commerce Experiences by making pre-production testing faster and more reliable. It achieves this by providing centralized platforms for distributed test execution, customer test data creation tools, flaky test analytics and management, and more.

About the role

We are looking for an experienced Senior Software Engineer with a demonstrated ability to build and enhance language-agnostic testing tools and telemetry which scales to meet the demand of millions of test runs per month.

Our ideal candidate is passionate about developer productivity, and thrives on the satisfaction of empowering Commerce Engineering engineers worldwide to quickly and comprehensively test their software. They are excited to leverage their experience building and maintaining automated testing and resilience platforms to provide long-term benefits.

Key responsibilities

Common languages and tools: Java, Javascript, Python, GraphQL, Github Actions, Selenium WebDriver, Playwright, Jest, Cucumber, Mocha

• Implement and manage software solutions that provide accurate and efficient analysis of test runs

• Create and maintain tools for framework-agnostic analysis of distributed tracing tools for test runs

• Develop and integrate software solutions which provide high-quality synthetic test data generation

• Integrate internal and vendor-provided distributed test execution infrastructure into engineering workflows with a focus on reliability and ease of use

• Develop and execute integration, visual screenshot, API, mock, contract, and performance tests to ensure reliability and scalability of frontend & backend systems.

• Design and develop tools and infrastructure to automatically detect, quarantine, and reproduce flaky tests

• Correlate test coverage data with code changes, runtime execution, and trace data for comprehensive reporting

• Maintain a strong focus on scalability, usability, and reliability in platform design to support a growing cohort of stunning engineers

• Stay informed about industry trends and emerging technologies to ensure Commerce Engineering remains at the forefront of testing infrastructure.

• Experience defining a testing strategy in partnership with other cross functional partners to build reliable systems.

• Document test strategies, frameworks, and troubleshooting guides for internal teams.

Must Haves

• A stunning software engineer with experience working on developer platform or productivity teams

• Has deep understanding of automation tools and frameworks

• A meticulous software designer who researches and documents technical tradeoffs clearly and concisely

• A self-motivated and organized individual who can independently drive org-wide solutions

• A proactive communicator who engages effectively with technical and non-technical stakeholders

• An advocate for a strong testing culture, having familiarity with popular test frameworks, code coverage tools, continuous integration systems, and post-deployment verification methods (healthy contempt for flaky tests is a plus)

• Passionate about solving developer productivity challenges for engineers. Support team members and partners to boost productivity

Nice To Haves

• You have shipped and maintained Java or JavaScript code in production

• You have designed and implemented metrics data pipelines

• Experience running and operating continuous integration systems like GitHub Actions, Jenkins, CircleCI and others 

• Guide the roadmaps of Infrastructure teams according to the specific needs and requirements of product-focused team members

• Keep up-to-date with the latest research, tools, and industry standards in GenAI testing and evaluation, and drive the adoption of relevant practices within the team.

• You have generated and analyzed traces like Distributed tracing/ Zipkin/ Honeycomb/ Datadog/ Splunk/ Elastic Search APM

• You have implemented advanced log, metric, or error stack trace analysis

• You strive to elevate the knowledge and skills of yourself and others in a way that fosters an inclusive, collaborative environment. Deeply enjoy working on solutions that empower other engineers in their work

• Thrive in an ambiguous environment and can self-manage and self-prioritize your time, energy, and resources

• Understand engineering is a team sport and actively farm for feedback and dissent

• Experience working with a globally distributed team

Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.