Senior Product Manager, Inference

Together AI

Where
San Francisco
Pay
$250 an hour
Type
Full time

Posted 3 months ago· Checked live at Together AI 49 minutes ago

Stale: open 94 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Together AI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Together AI's own hiring page 49 minutes ago.
What is the job?
Inference is a critical part of Together AI’s vision and growth strategy. Developers and enterprises use Together to run leading open models across coding agents, AI-native applications, enterprise workflows, and large-scale production workloads. We’re looking for a Senior Product Manager to shape how customers consume and build on Together inference.
What does it pay?
$250 an hour, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Inference is a critical part of Together AI’s vision and growth strategy. Developers and enterprises use Together to run leading open models across coding agents, AI-native applications, enterprise workflows, and large-scale production workloads.

We’re looking for a Senior Product Manager to shape how customers consume and build on Together inference.

Responsibilities

  • Shape the inference product strategy. Define how Together’s portfolio should serve different customer needs across tenancy, capacity, performance, workload patterns, and modalities.
  • Own the developer experience around inference. Improve our APIs, SDKs, compatibility, and integrations across applications, coding agents, frameworks, and developer tools.
  • Build for emerging workloads and modalities. Understand how agentic, voice, multimodal, batch, and other workload patterns are changing what customers need from inference infrastructure, and translate those shifts into product direction.
  • Turn infrastructure and model capabilities into customer-facing products. Work closely with inference platform engineers and researchers to understand capabilities and constraints across performance, routing, caching, reliability, capacity, and model behavior, and translate them into the right abstractions, guarantees, and controls for customers.
  • Connect product decisions to business outcomes. Shape pricing and packaging alongside Finance and GTM, and use adoption, inference consumption, utilization, unit economics, and customer expansion to prioritize where we invest.
  • Stay close to customers and the product. Talk with developers and enterprise teams, inspect usage patterns, test workflows yourself, and use that context to form a clear point of view on what we should build and what we should not.
  • Drive products from idea to production. Partner closely with engineering, research, sales, partnerships, finance, and other teams to make tradeoffs, align around priorities, launch, and iterate.

Requirements

  • Strong product judgment and the ability to take an ambiguous technical problem, identify what matters, make tradeoffs, and develop a clear point of view.
  • Meaningful experience building or owning APIs, developer tools, infrastructure, cloud platforms, data systems, AI products, or another technically deep product.
  • Strong technical depth and curiosity. You can work credibly with engineers and researchers, reason about system behavior and constraints, and go deeper when the product problem requires it.
  • A hands-on operating style. You’re comfortable testing APIs and SDKs, using developer tools, reading technical documentation or code when useful, and building lightweight prototypes or analyses to sharpen your thinking.
  • Strong developer and customer empathy. You care about what a system actually feels like to integrate with and operate in production, not just whether the underlying capability exists.
  • A track record of making clear product decisions and shipping in fast-moving environments where the right answer is not always obvious.
  • Strong communication and cross-functional leadership, with the ability to earn trust across engineering, research, customers, and business teams.

Experience with LLM inference, model serving, distributed systems, GPU infrastructure, agents, or developer-facing AI products is helpful, but not required. We care most about your ability to learn technical systems quickly, get close to the product, and develop strong judgment.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250 - 300k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Application Policy

Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.

Similar open jobs

Product manager jobs in San Francisco (487)Jobs in San Francisco (11750)