Product Manager, Inference Platform

Cohere

Where
Remote (Toronto)
Pay
$75 an hour
Type
Full time

Posted 14 days ago· Checked live at Cohere 26 minutes ago

Stale: open 14 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Cohere asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Cohere's own hiring page 26 minutes ago.
What is the job?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
What does it pay?
$75 an hour, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

Responsibilities

  • Own the P&L for Inference as a Service: carry the revenue number, set the rate card, and keep blended margin above the floor as the catalog and the fleet grow.
  • Own the inference platform itself: the console and dashboards where customers see usage, spend, API keys, access control and attestation, and the value-add tooling that makes a managed endpoint worth more than a raw one.
  • Own the model inventory across first-party and third-party models: what enters the catalog, how it is grouped by provenance, what it is priced at, and when something is quantised, replaced or retired.
  • Set the roadmap and the investment case across serving efficiency, the self-serve surface and regional capacity, and make the call when those three compete for the same budget.
  • Build the commercial motion with GTM from the ground up: self-serve acquisition for the mid-market, a sales-led motion for enterprise, and the partnerships that monetise capacity we would otherwise leave idle.
  • Stay close to the market: talk to customers and developers about integration friction and unmet needs, track competitor pricing, catalogs and launches, and follow where models and hardware are heading, then turn that into a clear view of where we should place our bets and what it would take to win.
  • Define the metrics that tell us whether this is a business, including revenue, margin, win rate, time to first token and self-serve share, and lead the work that moves them.
  • Partner with engineering, research, legal, finance, technical writing and developer relations to ship the platform and clear the licensing, pricing and capacity decisions behind it.
  • Represent the business to the executive team with a recommendation, the evidence behind it and the trade-off it implies.

Requirements

  • 10+ years of product management experience, including meaningful time owning a B2B infrastructure or platform product at the scope of a business rather than a feature area.
  • Experience operating in a GM-like capacity: you have carried a revenue line or a P&L, set pricing, and been held to margin as well as to shipping.
  • Background at a neocloud such as Together AI, Baseten or Fireworks, or at a hyperscaler such as AWS, Azure, OCI or Google Cloud, with a working view of how inference capacity is priced, packaged and sold, and a point of view on where the segment goes next.
  • A track record of thinking about infrastructure as a product, with the ability to translate system-level capabilities into clearly differentiated, customer-facing features.
  • Entrepreneurial, with experience taking a new product to market and building the commercial motion around it rather than inheriting one.
  • Experience with deployment models such as multi-tenant and dedicated infrastructure, and ownership across the full product lifecycle, from problem definition through launch, iteration and eventual migration or deprecation.
  • Analytical by default: you define success metrics before you build, instrument thoughtfully, and use data alongside qualitative feedback to make decisions.
  • Able to set direction and earn alignment across engineering, infrastructure, finance, legal and GTM without formal authority, and to put a clear recommendation and its trade-offs in front of an executive audience.

Nice-to-haves

  • Experience owning a model serving or inference platform, including self-serve infrastructure and metered inference offerings.
  • Exposure to data residency, sovereignty, or regional compliance requirements as they apply to AI or cloud infrastructure products, particularly in the inference-as-a-service context.
  • Familiarity with the AI developer ecosystem and open standards, including orchestration frameworks such as LangChain and LlamaIndex, model serving frameworks such as vLLM, and an awareness of de facto interoperability standards and how they shape developer adoption and integration patterns for inference workloads.
  • Experience with GPU infrastructure and cloud deployment models across both neocloud and hyperscaler environments.

Full-time employees at cohere enjoy these perks

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Annual enrichment benefits:

Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)
  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

Similar open jobs

Product manager jobs in Toronto (53)Remote product manager jobs (732)Jobs in Toronto (825)