Site Reliability Engineer (High Performance Computing)

SpaceX

Where
Hawthorne, CA
Pay
$125K a year

Posted 57 days ago· Checked live at SpaceX 1 hour ago

Stale: open 57 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what SpaceX asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on SpaceX's own hiring page 1 hour ago.
What is the job?
SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.
What does it pay?
$125K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.

Responsibilities

  • Participate in the team's on-call rotation; practice sustainable incident response and blameless postmortems
  • Manage node lifecycle with infrastructure as code: OS images, firmware, configuration management, kernel and driver stack
  • Build observability for both HPC administrators and end users — cluster, node, and storage health for operators, and job/workflow-level signal for the people running work on the platform
  • Reduce toil with automation; split time between operating production systems and writing the software that makes that work smaller
  • Sustainably manage resources, including compute and storage
  • Lead capacity planning with users across the company: understand what they will need next, and turn that into a concrete picture of tomorrow's compute and storage
  • Collaborate with HPC systems engineers and with engineers across all disciplines across the company on operable, maintainable infrastructure

Basic qualifications

  • Bachelor's degree in computer science, engineering, math, or a scientific discipline; OR 2+ years of professional experience operating production infrastructure in lieu of a degree
  • 2+ years of experience with Linux operating systems in production
  • 2+ years of experience operating production infrastructure (servers, services, or networks), including monitoring, debugging, and repairing what you own

Preferred skills and experience

  • 2+ years of professional experience in SRE, DevOps, or production infrastructure engineering
  • Experience with monitoring and alerting (Prometheus, Grafana, Nagios, or similar)
  • Experience deploying and maintaining configuration management or infrastructure as code (Ansible, Puppet, Terraform, or similar)
  • Experience writing scripts/code (eg. Python or similar languages) to automate common tasks
  • Experience with containers (Docker, Podman, Singularity/Apptainer)
  • Experience with Kubernetes administration for on-premise deployment
  • Experience with distributed or high-performance storage (VAST or similar), including capacity, performance, and lifecycle management
  • Familiarity with HPC clusters, schedulers (Slurm, PBS, LSF), or GPU compute — not required; we will teach this
  • Familiarity with scientific computing (CFD, FEA) and/or ML training workloads (PyTorch, TensorFlow, CUDA) and/or AI inference workloads
  • Good understanding of version control, testing, continuous integration, build, deployment and monitoring
  • Ability to communicate clearly with users, peers, and vendors in both incident and design settings
  • Comfortable working with mission-critical and sensitive systems, with a sense of urgency appropriate to the responsibilities
  • Eligibility for access to classified material up to TS/SCI with polygraph

Additional requirements

  • Position is based in Hawthorne, CA and is primarily on-site
  • Must be able to participate in an on-call rotation
  • Must be willing to work extended hours and weekends as needed for incidents, cluster bring-up, and time-critical failures

Pay Range

Level 1: $125,000.00 - $160,000.00

Level 2: $145,000.00 - $195,000.00

Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

Base salary is just one part of your total rewards package at SpaceX. You may also be eligible for long-term incentives, in the form of company stock or long-term cash awards, as well as potential discretionary bonuses and the ability to purchase additional stock at a discount through an Employee Stock Purchase Plan. You will also receive access to comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short and long-term disability insurance, life insurance, paid parental leave, and various other discounts and perks. You may also accrue 3 weeks of paid vacation and will be eligible for 10 or more paid holidays per year. Employees accrue paid sick leave pursuant to Company policy which satisfies or exceeds the accrual, carryover, and use requirements of the law.

Itar requirements

  • To conform to U.S. Government export regulations, applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder), (iii) Refugee under 8 U.S.C. § 1157, or (iv) Asylee under 8 U.S.C. § 1158, or be eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here.

SpaceX is an Equal Opportunity Employer; employment with SpaceX is governed on the basis of merit, competence and qualifications and will not be influenced in any manner by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability or any other legally protected status.

Applicants wishing to view a copy of SpaceX’s Affirmative Action Plan for veterans and individuals with disabilities, or applicants requiring reasonable accommodation to the application/interview process should reach out to EEOCompliance@spacex.com.