Distributed Systems Engineer (L4) - Data Platform

Netflix

Netflix

Software Engineering
United States · Remote
Posted on Oct 19, 2024

Netflix is one of the world’s leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Role

The Data Platform teams at Netflix enable us to leverage data to bring joy to our members in many different ways. We provide centralized data platforms and tools for various business functions at Netflix, so they can utilize our data to make critical data-driven decisions. We do all the heavy lifting to make it easy for our business partners to work with data efficiently, securely, and responsibly. We aspire to lead the industry standard in building a world-class data infrastructure, as Netflix leads the way to be the most popular and pervasive destination for global internet entertainment.

We are looking for distributed systems engineers to help evolve and innovate our infrastructure. We are committed to building a diverse and inclusive team that will bring new perspectives as we solve the next set of challenges. In addition, we are open to remote candidates. We value what you can do from anywhere in the U.S.

Spotlight on Data Platform Teams:

Big Data Warehouse and Iceberg
The Big Data Warehouse and Iceberg team is responsible for Netflix's exabyte-scale data warehouse, building and operationalizing foundational services to manage the lifecycle of core tables critical for all analytical, reporting, and data decision needs. These services enable query engines to discover tables/datasets, provide secure access to data, and efficiently store data in S3 using Iceberg table format. Additionally, the team works on efficiencies of compute, storage, and network costs, and optimality of data storage, and ensures that the data meets Netflix's standards and compliance requirements. The team is also committed to developing new features and enhancements to the Iceberg table format (which began in Netflix and is now an industry standard) and contributing to the open source.

Online Data Stores - Caching, Relational & Search

Online Data Stores organization offers managed data stores at scale to meet Netflix’s operational data requirements across all lines of business. These data stores cover various types, including Caching, Relational, Search, Key-Value, and Composite abstractions. Our focus is on developing and maintaining high-performance, reliable, and efficient data stores. Additionally, we enhance developer productivity by providing secure, intuitive, and opinionated access layers.

This particular team focuses on datastores and abstractions related to caching including EVCache (memcached), Redis, Hollow, and relational stores including RDS, Aurora, CockroachDB, and search stores including Opensearch and GenAI storage related to Retrieval Augmented Generation.

Data Movement Platform - Connectors
The Data Movement Connector team is responsible for developing and managing a range of data connectors that facilitate both batch and streaming processing by connecting data stores to the rich data movement products for additional processing.

This team creates and maintains a data connector platform that allows other teams to efficiently develop their own connectors as well. This team uses Spark for batch connectors and Kafka and Flink for streaming connectors, working with various data stores such as Cassandra and PostgreSQL. Responsibilities include handling CDC (Change Data Capture) events, building the control plane, building Spark, Flink connectors, interacting with multiple data stores, building bulk data transfer toolings, automating operations.


This would be your dream job if you enjoy:

  • Solving real business needs at large scale by applying your software engineering and analytical problem-solving skills.

  • Architecting and building a robust, scalable, and highly available distributed infrastructure.

  • Leading cross-functional initiatives and collaborating with engineers, product managers, and TPM across teams.

  • Sharing our experiences with the open source communities and contributing to Netflix OSS.


About you:

  • You have 2+ years of experience in building large-scale distributed systems features or applications.

  • You are proficient in the design and development of RESTful web services.

  • Experienced in building and operating scalable, fault-tolerant, distributed systems

  • You are experienced in Java or other object-oriented programming languages.

  • Multi-threading is a challenge that you are comfortable tackling.

  • You have a BS in Computer Science or a related field.


A few more things about us:

As a team, we come from many different countries and our fields of education range from the humanities to engineering to computer science. Our team includes product managers, program managers, designers, full-stack developers, distributed systems engineers, and data scientists. Folks have the opportunity to wear different hats, should they choose to. We strongly believe this diversity has helped us build an inclusive and empathetic environment and look forward to adding your perspective to the mix!

Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $170,000 - $720,000.

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off.

Netflix is a unique culture and environment. Learn more here.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity of thought and background builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.