Senior Software Engineer - Storage Control Plane

Lambda

Where
Hybrid in San Francisco Office (Fremont St)

Posted 3 months ago· Checked live at Lambda 2 hours ago

Stale: open 98 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Lambda asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Lambda's own hiring page 2 hours ago.
What is the job?
Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU. If you'd like to build the world's best AI cloud, join us.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU.

If you'd like to build the world's best AI cloud, join us.

Our expertise lies at the intersection of

  • High-Performance Distributed Storage Solutions and Protocols: We engineer the protocols and systems that serve massive datasets at the speeds demanded by modern clustered GPUs.
  • Dynamic Networking: We design advanced networks that provide multi-tenant security and intelligent routing without compromising performance, using the latest in AI networking hardware.
  • Compute Clustering and Virtualization: We enable cutting-edge virtualization and clustering that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure, unleashing the full compute bandwidth of clustered GPUs.

AI training and inference relies on petabytes of data hosted on large, high-performance storage arrays. At Lambda, the Infrastructure Storage Team’s job is to ensure that the data powering AI is fast, performant, and available across a variety of access protocols (fit for purpose).

We're looking for an experienced Senior Software Engineer to join our storage team. You'll join a team responsible for developing and implementing our next-generation storage software. This role requires expertise in distributed systems, and an in-depth understanding of file, block, and object storage protocols. You'll work on building scalable and resilient storage control plane that power our AI and machine learning infrastructure.

What You’ll Do

  • Design and build a vendor-agnostic control plane that provisions, scales, heals, and meters storage across the platforms our customers actually demand, VAST Data, WEKA, DDN, Pure, NetApp, Ceph, MinIO, and the ones that don't exist yet.
  • Define the internal abstraction layer that hides vendor-specific APIs, failure semantics, QoS knobs, and telemetry formats behind one declarative interface, so a new vendor integration is a driver, not a re-architecture.
  • Build reconciliation-loop and CRD-based orchestration (Kubernetes controllers, operators, custom schedulers) that manages capacity, tenancy, encryption domains, and placement across data centers and availability zones.
  • Own multi-tenant isolation end to end: namespace and subsystem partitioning, per-tenant QoS and rate limiting, credential and key lifecycle, blast-radius containment, noisy-neighbor detection.
  • Design the capacity and placement engine: PCIe-topology-aware, NUMA-aware, failure-domain-aware. On our platforms a drive behind the same PCIe switch as the GPU it serves beats a faster drive on a different root port, and the control plane needs to know that.
  • Instrument everything: SLI/SLO definitions, fleet-wide performance regression detection, and the observability pipeline that makes a petabyte fleet debuggable at 3 a.m.

Nice to Have

  • Experience with AI/ML workloads and the unique storage challenges they present.
  • Knowledge of data center networking and high-speed interconnects (e.g., InfiniBand, RoCE).
  • Experience with performance tuning and optimization of storage systems.
  • Familiarity with hardware acceleration technologies, specifically GPUs and DPUs.
  • Production experience with VAST Data, WEKA, DDN, Pure, NetApp, or IBM Storage Scale.
  • Ceph at 100 PB+ in HPC or AI environments.
  • CXL memory pooling, computational storage, ZNS SSDs, EDSFF.
  • Published or presented at SNIA SDC, FAST, USENIX ATC, LSFMM+BPF, OCP, SC, or similar.

Salary Range Information

The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

Similar open jobs

Software engineer jobs in San Francisco (1709)Software engineer jobs in Seattle (980)Jobs in San Francisco (11750)Jobs in Seattle (5777)