Software Engineer, Spark Platform

DoorDash USA

Where
San Francisco, CA; Sunnyvale, CA; Seattle, WA; New York City, NY
Pay
$131K to $192K a year

Posted 36 days ago· Checked live at DoorDash USA 2 hours ago

Stale: open 36 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what DoorDash USA asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on DoorDash USA's own hiring page 2 hours ago.
What is the job?
The Spark Platform team owns and operates DoorDash's Apache Spark ecosystem — the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant scale and continue to expand the workloads, capabilities, and consumer base we serve.
What does it pay?
$131K to $192K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

The Spark Platform team owns and operates DoorDash's Apache Spark ecosystem — the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant scale and continue to expand the workloads, capabilities, and consumer base we serve.

We're excited about you because…

  • B.S., M.S., or PhD in Computer Science or equivalent.
  • 2+ years of industry experience operating production distributed systems.
  • Experience operating Apache Spark at scale on Amazon EMR, Databricks, or an in-house deployment — with a focus on platform operations (runtime upgrades, cluster lifecycle, shuffle, observability, multi-tenant scheduling) rather than authoring individual Spark jobs.
  • Hands-on experience operating production systems on Kubernetes — controllers, operators, custom resources, and the failure modes that show up in multi-tenant clusters.
  • Familiarity with batch or big-data schedulers (YuniKorn, Volcano, Kueue, or equivalent) and/or with the Spark-on-Kubernetes operator.
  • Familiarity with observability stacks (Prometheus, OpenTelemetry, distributed tracing, structured logging) and with defining SLOs and SLIs that change team behavior.
  • Comfort working in a cloud environment (AWS preferred) — VPC networking, instance lifecycle, spot/preemptible markets, and autoscaling primitives.
  • Professional experience with Python, Go, Scala, or Java; SQL fluency.
  • A bias toward incremental rollout, measurement, and reducing toil.
  • You are located or willing to relocate to the Bay Area, Seattle, or NYC.

Compensation

The successful candidate’s starting pay will fall within the pay range listed below and is determined based on job-related factors including, but not limited to, skills, experience, qualifications, work location, and market conditions. Base salary is localized according to an employee’s work location. Ranges are market-dependent and may be modified in the future.

In addition to base salary, the compensation for this role includes opportunities for equity grants. Talk to your recruiter for more information.

DoorDash cares about you and your overall well-being. That’s why we offer a comprehensive benefits package to all regular employees, which includes a 401(k) plan with employer matching, 16 weeks of paid parental leave, wellness benefits, commuter benefits match, paid time off and paid sick leave in compliance with applicable laws (e.g. Colorado Healthy Families and Workplaces Act). DoorDash also offers medical, dental, and vision benefits, 11 paid holidays, disability and basic life insurance, family-forming assistance, and a mental health program, among others.

To learn more about our benefits, visit our careers page here.

Similar open jobs

Software engineer jobs in San Francisco (1709)Software engineer jobs in New York (1437)Software engineer jobs in Seattle (980)Software engineer jobs in San Jose (1462)Jobs in San Francisco (11750)Jobs in New York (19157)Jobs in Seattle (5777)Jobs in San Jose (7796)