Director Site Reliability Engineer, AI Infrastructure

D Matrix

Where
Hybrid in Santa Clara

Posted 54 days ago· Checked live at D Matrix 1 hour ago

Stale: open 54 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what D Matrix asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on D Matrix's own hiring page 1 hour ago.
What is the job?
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today.

What you will do

  • Build and lead the SRE function from scratch: define its charter, establish SRE as a discipline across hardware and software engineering, and hire, develop, and retain a team of 1–3 SRE engineers.
  • Lead the Data Center & Lab Technician team, setting priorities and operational standards across on-premises and colocation facilities.
  • Own 24×7 reliability across colocation, on-premises lab clusters, cloud, and customer-facing platform services, designing for failure domains, progressive delivery, and strict change control.
  • Establish SRE processes: define SLIs, SLOs, and error budgets, design on-call rotations (including a follow-the-sun model as d-Matrix expands globally), and build the incident and root cause analysis (RCA) framework.
  • Own the observability stack (Prometheus, Grafana, Datadog, Splunk, or equivalent), instrumenting metrics, traces, and logs for SLO visibility and alert design.
  • Drive IaC-first automation (Terraform, Ansible) and build self-healing infrastructure, including host lifecycle automation, fleet auto-remediation, and AIOps-driven alerting.
  • Own FinOps and capacity planning across cloud, colocation, and on-premises environments, including spend attribution, TCO modeling, and workload placement decisions.
  • Lead the migration from ad-hoc JBOD storage to an enterprise-grade shared storage platform across on-prem, colocation, and cloud, including architecture, vendor selection, and disaster recovery design.

Preferred qualifications

  • Experience operating customer-facing infrastructure or platform services with reliability expectations beyond internal tooling.
  • Knowledge of high-speed interconnect fabrics such as InfiniBand, RoCE, or NVLink, including setup, troubleshooting, and performance tuning.
  • Experience with HPC job schedulers (Slurm, LSF, or equivalent), including setup, tuning, and integration with infrastructure automation.
  • Multi-cloud hybrid operations across AWS, Azure, and GCP alongside on-prem and colo, with unified observability and IaC.
  • FinOps expertise, including cloud spend attribution, TCO modeling across cloud, on-prem, and colo, and translating cost data into workload placement recommendations.
  • Familiarity with ITIL or an equivalent structured incident, problem, and change management framework.
  • Published technical writing, conference talks, or open-source contributions in reliability, observability, or HPC infrastructure.

Similar open jobs

Site reliability engineer jobs in San Jose (99)Jobs in San Jose (7796)