Technical Program Manager, Compute Infrastructure

OpenAI

Where
Hybrid in San Francisco

Posted 14 days ago· Checked live at OpenAI 9 minutes ago

Stale: open 14 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 9 minutes ago.
What is the job?
The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation of models. We provide a unified platform for OpenAI teams to run production Applied AI and Research training workloads.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation of models. We provide a unified platform for OpenAI teams to run production Applied AI and Research training workloads.

In this role, you will

  • Own the GPU supply signal across the fleet. Maintain a trusted view of incoming capacity across providers, sites, and clusters, including quantities, delivery forecasts, acceptance and readiness milestones, and expected dates for production use. Make changes and their downstream effects visible.
  • Build and scale the tools, data, and platform behind that signal. Own the roadmap, requirements, delivery, and adoption, partnering with Engineering on data models, integrations, quality checks, and planning workflows. Serve Product TPMs, Capacity TPMs, and Compute TPMs, alongside Finance, Accounting, leadership, Engineering, and Research.
  • Connect supply with capacity planning. Partner with Capacity Planning on supply and demand management, allocation planning, and scenario analysis. Ensure plans reflect current supply forecasts, infrastructure constraints, and the effects of early or late deliveries.
  • Coordinate physical readiness for new capacity. Work closely with Data Center Infrastructure and cloud service providers to align ready-for-service dates, site construction, power and cooling readiness, supply-chain convergence, equipment delivery, and commissioning. Track dependencies and drive resolution of gaps that threaten deployment.
  • Lead logical readiness across infrastructure resources. Coordinate CPU, storage, network, GPU, Kubernetes, and dependent compute foundation services so new clusters can support their intended workloads. Make clear which missing services or resources could delay GPU use.
  • Drive deployment across cloud and bare metal environments. Lead integrated plans across AWS, GCP, Azure, OCI, and other infrastructure partners, accounting for provider-specific dependencies while establishing consistent readiness criteria and handoffs.
  • Establish Delivery Scorecards for cloud providers and internal infrastructure teams. Track delivery commitments, forecast changes, actual delivery, readiness milestones, and time to usable capacity. Use these scorecards to identify recurring gaps, clarify recovery actions, and improve delivery predictability.
  • Improve the reliability and repeatability of cluster bringup. Partner with Engineering to scale automation, runbooks, validation, and deployment processes. Reduce manual coordination and the time between capacity delivery and production use.
  • Manage the critical paths across concurrent programs. Establish clear milestones, owners, dependencies, and escalation paths. Resolve cross-team blockers and drive decisions that keep site and cluster deployments moving.
  • Communicate progress, risks, and tradeoffs clearly. Give technical and business stakeholders the information they need to understand capacity availability, assess changes to the plan, and make timely decisions.

You might thrive in this role if you

  • Have 5+ years of experience leading major technical programs, including compute infrastructure, hyperscaler deployments, capital projects, or similarly complex infrastructure work.
  • Possess a degree in a hard science or engineering discipline, or have a demonstrated track record of equivalent engineering expertise.
  • Are familiar with Kubernetes deployments and have worked with at least one major cloud provider—such as AWS, GCP, Azure, or OCI—to scale compute infrastructure. Experience coordinating deployments across multiple providers is valuable.
  • Are familiar with bare metal GPU capacity and the provisioning, inventory, and planning systems used to bring it into service.
  • Have worked with Capacity Planning teams on supply and demand management, allocations, constraints, and supporting tools. You understand how changes in delivery or readiness affect downstream capacity plans.
  • Have experience defining requirements for operational data and internal platforms. You can work with engineers to establish useful data models, improve data quality, and build tools that teams adopt and rely on.
  • Understand how site readiness, power and cooling, equipment delivery, commissioning, and ready-for-service milestones affect cluster deployment. You can coordinate these dependencies without losing sight of when the intended workload can run.
  • Have a record of owning and delivering complex technical programs across internal teams and external partners, including cloud providers, equipment suppliers, or data center infrastructure teams.
  • Are technically adept and comfortable working with Engineering and Research to understand dependencies, evaluate tradeoffs, and turn complex problems into executable plans.
  • Build simple, scalable processes and communicate clearly with both technical teams and business stakeholders. You are resourceful in ambiguous environments and follow issues through to resolution.
  • Are interested in and thoughtful about the impacts of AGI.

Similar open jobs

Program manager jobs in San Francisco (310)Jobs in San Francisco (11750)