Senior Software Engineer — Commerce Experiences Testing Infrastructure
Netflix
Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.
About the Team
The Testing Tools & Infrastructure team within the Consumer Lifecycle Experiences Platform is crucial to our Commerce organization. It serves Commerce Experiences by making pre-production testing faster and more reliable. It achieves this by providing centralized platforms for distributed test execution, customer test data creation tools, flaky test analytics and management, and more.
About the role
We are looking for an experienced Senior Software Engineer with a demonstrated ability to build and enhance language-agnostic testing tools and telemetry which scales to meet the demand of millions of test runs per month.
Our ideal candidate is passionate about developer productivity, and thrives on the satisfaction of empowering Commerce Engineering engineers worldwide to quickly and comprehensively test their software. They are excited to leverage their experience building and maintaining automated testing and resilience platforms to provide long-term benefits.
Key responsibilities
Common languages and tools: Java, Javascript, Python, GraphQL, Github Actions, Selenium WebDriver, Playwright, Jest, Cucumber, Mocha
Implement and manage software solutions that provide accurate and efficient analysis of test runs
Create and maintain tools for framework-agnostic analysis of distributed tracing tools for test runs
Develop and integrate software solutions which provide high-quality synthetic test data generation
Integrate internal and vendor-provided distributed test execution infrastructure into engineering workflows with a focus on reliability and ease of use
Develop and execute integration, visual screenshot, API, mock, contract, and performance tests to ensure reliability and scalability of frontend & backend systems.
Design and develop tools and infrastructure to automatically detect, quarantine, and reproduce flaky tests
Correlate test coverage data with code changes, runtime execution, and trace data for comprehensive reporting
Maintain a strong focus on scalability, usability, and reliability in platform design to support a growing cohort of stunning engineers
Stay informed about industry trends and emerging technologies to ensure Commerce Engineering remains at the forefront of testing infrastructure.
Experience defining a testing strategy in partnership with other cross functional partners to build reliable systems.
Document test strategies, frameworks, and troubleshooting guides for internal teams.
Must Haves
A stunning software engineer with experience working on developer platform or productivity teams
Has deep understanding of automation tools and frameworks
A meticulous software designer who researches and documents technical tradeoffs clearly and concisely
A self-motivated and organized individual who can independently drive org-wide solutions
A proactive communicator who engages effectively with technical and non-technical stakeholders
An advocate for a strong testing culture, having familiarity with popular test frameworks, code coverage tools, continuous integration systems, and post-deployment verification methods (healthy contempt for flaky tests is a plus)
Passionate about solving developer productivity challenges for engineers. Support team members and partners to boost productivity
Nice To Haves
You have shipped and maintained Java or JavaScript code in production
You have designed and implemented metrics data pipelines
Experience running and operating continuous integration systems like GitHub Actions, Jenkins, CircleCI and others
Guide the roadmaps of Infrastructure teams according to the specific needs and requirements of product-focused team members
Keep up-to-date with the latest research, tools, and industry standards in GenAI testing and evaluation, and drive the adoption of relevant practices within the team.
You have generated and analyzed traces like Distributed tracing/ Zipkin/ Honeycomb/ Datadog/ Splunk/ Elastic Search APM
You have implemented advanced log, metric, or error stack trace analysis
You strive to elevate the knowledge and skills of yourself and others in a way that fosters an inclusive, collaborative environment. Deeply enjoy working on solutions that empower other engineers in their work
Thrive in an ambiguous environment and can self-manage and self-prioritize your time, energy, and resources
Understand engineering is a team sport and actively farm for feedback and dissent
Experience working with a globally distributed team
Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.
We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.