Principal Product Manager, AI Infrastructure and Orchestration

DataRobot, Inc.

Where
San Francisco, California, US

Posted 17 days ago· Checked live at DataRobot, Inc. 4 days ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what DataRobot, Inc. asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on DataRobot, Inc.'s own hiring page 4 days ago.
What is the job?
DataRobot delivers AI that maximizes impact and minimizes business risk. Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale. DataRobot empowers practitioners to deliver predictive and generative AI, and enables leaders to secure their AI assets.
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

DataRobot delivers AI that maximizes impact and minimizes business risk. Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale. DataRobot empowers practitioners to deliver predictive and generative AI, and enables leaders to secure their AI assets.

What we are looking for

  • 6+ years in product management for infrastructure, developer platforms, or cloud services, at least 3 of them on Kubernetes-based or distributed systems products. Principal candidates bring 9+ years and a platform layer that other product teams built on.
  • Deep technical understanding of GPU and accelerator behavior: topology-aware placement, fractional and time-sliced sharing, MIG, device plugins and the driver and container runtime plumbing underneath them, memory as the binding constraint, and what utilization costs when a tenant holds a GPU it is not saturating.
  • Deep technical understanding of Kubernetes: the API server and scheduler, controllers and CRDs, operators, admission and RBAC, device plugins, resource requests and limits, node pools, and what happens when a pod cannot be scheduled.
  • Multi-tenancy experience: isolation models, noisy neighbors, quota and fairness, and tenancy designs that survive a customer security review.
  • API product judgment. You have owned a public or platform API and lived with the consequences of a contract you shipped.
  • Technical writing and prototyping as your default way to make a case: a doc an engineer will read, a deep dive, a public post, an API reference, or a working prototype.
  • Comfort operating with matrixed engineering teams and no direct reports.
  • BS or MS in Computer Science or a closely related technical field, or equivalent hands-on experience as a software, platform, or infrastructure engineer.

Nice to have

  • Service networking depth: ingress and routing, load balancing under uneven request cost, DNS, TLS termination, private link connectivity, and network policy as a tenancy boundary.
  • Modern serving stacks and their failure modes: vLLM or similar, KV cache behavior, batching, quantization trade-offs.
  • Long-running and agentic workload patterns: session affinity, statefulness, tool-call fan-out, sandboxed execution.
  • Customer-managed, air-gapped, or sovereign deployments and the compliance constraints that come with them.
  • Regulated-industry experience where access control, secrets, and invocation-level auditability are product requirements.
  • CNCF or open-source contribution.

How we work with AI

We use AI tooling in the loop daily and expect the same here. The strongest candidates build to think: a prototype that exercises an API before it is specified, an evaluation harness, an agent wired against real services, a throwaway tool that answers a roadmap question in an afternoon. Bring one or two things you built yourself. Production-grade code is not the bar; getting to a first version without waiting on an engineer is.

Similar open jobs

Product manager jobs in San Francisco (480)Jobs in San Francisco (11741)