Software Engineer, Compute Foundations

OpenAI

Where
San Francisco

Posted 2 months ago· Checked live at OpenAI 4 minutes ago

Stale: open 63 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 4 minutes ago.
What is the job?
Compute Foundations builds the software that manages OpenAI’s GPU compute infrastructure across sites, data centers, and infrastructure providers, supporting model training and inference. Our systems turn large, heterogeneous fleets of machines into dependable compute for research and products.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Compute Foundations builds the software that manages OpenAI’s GPU compute infrastructure across sites, data centers, and infrastructure providers, supporting model training and inference. Our systems turn large, heterogeneous fleets of machines into dependable compute for research and products.

In this role, you will

  • Design, build, and operate Kubernetes-based controllers and distributed services that coordinate infrastructure across sites, isolate failures, and scale as GPU capacity grows.
  • Define APIs and resource models that let clients request and track lifecycle operations through consistent interfaces across hardware platforms and providers.
  • Build provisioning and configuration services that coordinate network boot, hardware management interfaces, and the deployment of firmware, operating-system images, drivers, and host configuration.
  • Develop lifecycle management for discovery, allocation, provisioning, upgrades, maintenance, recovery, and decommissioning, integrating with health and validation systems.
  • Design reliable reconciliation and recovery through concurrent changes, interrupted operations, and partial failures, with staged rollouts that limit disruption across nodes, racks, and clusters.
  • Improve control-plane throughput, API latency, and the time infrastructure takes to reach its desired state, while respecting the limits of site systems and provider APIs.
  • Build the software integrations that bring new sites and GPU hardware generations into the platform, partnering with hardware, networking, data-center, and other infrastructure teams.

You might thrive in this role if you

  • Have strong software engineering fundamentals and experience designing, implementing, and owning production distributed systems or infrastructure services.
  • Have experience developing infrastructure systems that use Kubernetes APIs and reconciliation to manage resources.
  • Understand how a bare-metal node moves from power-on to a configured, workload-ready system, with depth in one or more areas such as PXE, DHCP/DNS, baseboard management controllers (BMCs), firmware, Linux, drivers, images, or configuration management.
  • Can design reliable APIs and asynchronous workflows, reasoning about concurrency, consistency, idempotency, and failures across service and provider boundaries.
  • Can diagnose reliability and performance problems across service, operating-system, and machine boundaries, turning production evidence into lasting software improvements.
  • Work effectively across engineering specialties and communicate system behavior and technical tradeoffs clearly.

Bonus points if you

  • Have built infrastructure control planes that coordinate operations across multiple sites or regions.
  • Have worked with GPU or HPC infrastructure, including topology and shared dependencies across machines, racks, or clusters.
  • Have integrated multiple hardware platforms or infrastructure providers into a common service or resource model.

Similar open jobs

Software engineer jobs in San Francisco (1709)Jobs in San Francisco (11750)