Product Manager, Inference Experience

Baseten

Where
Hybrid in San Francisco

Posted 7 days ago· Checked live at Baseten 1 hour ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Baseten asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Baseten's own hiring page 1 hour ago.
What is the job?
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.

Responsibilities

  • Own product strategy and roadmap across Baseten's inference offerings, with a focus on developer adoption and business impact
  • Make it easier for developers to discover, evaluate, deploy, and manage AI models through our APIs, SDKs, CLI, and console
  • Work with inference engineers and researchers to turn technical advances into compelling customer-facing capabilities
  • Help determine which models, workloads, and customer needs we prioritize
  • Partner with GTM and leadership on pricing, packaging, launches, and commercialization
  • Spend time with developers and customers to understand what's working, what's frustrating, and what we should build next

Requirements

  • 10+ years building and shipping AI/ML products or platforms
  • A technical background in software engineering, ML engineering, research, or equivalent hands-on experience
  • Direct experience building or deploying models using technologies like PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar frameworks
  • Strong understanding of model serving, GPU economics, and the tradeoffs between quality, latency, throughput, and cost
  • Exceptional developer product instincts. You know how to make complex technology approachable without sacrificing power
  • A track record of leading cross-functional product initiatives and turning technical capabilities into measurable adoption or revenue growth

Nice to have

  • Experience deploying models, building infrastructure products, building ML infrastructure, or designing tools used from both a terminal and a console
  • Past experience as a software developer

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Similar open jobs

Product manager jobs in San Francisco (487)Product manager jobs in New York (808)Jobs in San Francisco (11750)Jobs in New York (19157)