Technical Program Manager, Capacity Analytics & Tooling

OpenAI

Where
Hybrid in San Francisco

Posted 14 days ago· Checked live at OpenAI 36 minutes ago

Stale: open 14 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 36 minutes ago.
What is the job?
The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation models. We operate a large, modern GPU fleet and provide a unified platform for other OpenAI teams to run production Applied AI and Research training workloads.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation models. We operate a large, modern GPU fleet and provide a unified platform for other OpenAI teams to run production Applied AI and Research training workloads.

In this role, you will

  • Own the product strategy and roadmap for supply and demand planning tools. Understand user needs, set priorities, define success measures, and guide delivery from initial requirements through adoption and ongoing improvement.
  • Build useful planning workflows. Translate complex processes into tools for demand intake, forecasting, supply tracking, scenario analysis, and allocation planning. Help teams understand what infrastructure they need, when it will be available, and which gaps require action.
  • Scale the data infrastructure behind capacity planning. Partner with engineering on ingestion, transformation, storage, and delivery of planning data. Guide technical tradeoffs as the number of resources, providers, data sources, and users grows.
  • Make planning data consistent and trustworthy. Establish shared data models and definitions for supply, demand, allocations, utilization, and cost. Drive data cleaning, validation, reconciliation, and traceability so users can understand and trust planning outputs.
  • Advance forecasting and analytical capabilities. Work with engineering and data partners to connect product and research plans to infrastructure demand. Make assumptions, uncertainty, forecast accuracy, and capacity constraints visible to decision makers.
  • Define and scale meaningful success metrics. Measure data quality, forecast performance, planning speed, and tool adoption. Establish consistent ways to track capacity availability, utilization, and efficiency across CPU, storage, network, and GPU resources.
  • Support planning across multiple cloud providers. Build capabilities that account for differences in resource types, regions, availability, commercial commitments, and deployment constraints across AWS, GCP, Azure, OCI, and other providers.
  • Lead delivery across data, infrastructure, and planning teams. Manage dependencies, technical tradeoffs, migrations, risks, and releases. Keep teams aligned on priorities and the decisions needed to move work forward.
  • Drive adoption and reduce manual planning work. Develop simple workflows, documentation, training, and feedback mechanisms. Identify recurring reconciliation and reporting work that can be improved through better data and automation.
  • Make capacity tradeoffs clear to leadership and partner teams. Provide useful views of gaps between supply and demand, allocation options, and their financial and operational consequences. Partner with Finance and Accounting to align planning data with budgeting and reporting needs.

You might thrive in this role if you

  • Have 5+ years of experience leading technical programs or products in data platforms, infrastructure, capacity planning, or a related field, with a record of delivering systems that teams rely on.
  • Have owned an internal product or platform roadmap and translated complex operational needs into requirements, priorities, and releases that users adopt.
  • Have direct experience with capacity planning, including demand forecasting, supply planning, allocations, and resource constraints. You understand how utilization, performance, availability, and cost affect planning decisions.
  • Understand modern data infrastructure, including ingestion, transformation, batch and streaming processing, and analytical storage. You have worked with technologies such as Fivetran, dbt, Spark, Kafka, or comparable systems and can discuss their architectural tradeoffs.
  • Have practical experience with data modeling, data cleaning, validation, and reconciliation. You can use SQL and Python or similar tools to investigate discrepancies, validate assumptions, and prototype analyses.
  • Have applied quantitative methods to forecasting, scenario analysis, or optimization. You can assess model assumptions and uncertainty, evaluate forecast performance, and explain the limitations of an analysis.
  • Understand the capacity, performance, and cost characteristics of compute, storage, networking, and accelerators. You have experience working across multiple cloud environments and can account for differences between providers.
  • Can lead complex programs with many technical dependencies and align teams with different priorities. You communicate technical tradeoffs clearly to engineers, researchers, finance partners, and leaders.
  • Are resourceful in ambiguous environments, exercise sound product judgment, and build simple, scalable ways to solve complex planning problems.
  • Are interested in and thoughtful about the impacts of AGI.

Similar open jobs

Program manager jobs in San Francisco (310)Jobs in San Francisco (11750)