Senior Director, Technical Product Management — AI Quality & Evaluation

Salesforce, Inc.

Where
California - San Francisco Metro - Remote
Pay
$218K to $365K a year

Posted 14 days ago· Checked live at Salesforce, Inc. 4 days ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Salesforce, Inc. asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Salesforce, Inc.'s own hiring page 4 days ago.
What is the job?
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category
What does it pay?
$218K to $365K a year, as the posting states.
Our verdict
Live. Open on the employer's own site.

What the job is

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Product

Job Details

Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life.

Core Responsibilities & Scope

  • Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes.
  • Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners.
  • Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership.
  • Personally lead customer investigations and experiments. For example, investigate why an agent gives an incorrect answer or fails a tool-driven workflow, define the expected behavior, and partner with researchers and engineers to test a change and validate its customer impact.
  • Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams.
  • Partner with researchers, applied scientists, and engineers to design credible evaluations. Apply AI/ML fundamentals such as training/test separation, overfitting, representative coverage, and independent validation to assess non-deterministic model behavior and grader reliability.
  • Lead delivery of capabilities that help customers understand and improve AI performance. For example, prototype an experience that turns a failed agent interaction into an evaluation case, makes the quality gap clear, and helps a customer verify whether a proposed change works.
  • Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise the quality of decisions through mentorship and practical example.
  • Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders.

Minimum Requirements

  • A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact.
  • Deep hands-on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers. One to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact.
  • Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements.
  • Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty. You can define what good looks like for a non-deterministic system and challenge conclusions with technical partners.
  • Principled, flexible thinking: frame the underlying customer problem, test assumptions, and change direction when evidence warrants it. You can explain when lessons from a previous product apply and when the context demands a different approach.
  • Experience establishing shared standards and resolving cross-team disagreements while preserving clear accountability and delivery momentum.
  • Evidence of coaching and mentoring colleagues without relying on reporting authority, and the ability to deliver independently in a fast-moving environment.
  • Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven.

Preferred Qualifications

  • Evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products.
  • Building in an AI-native startup or entrepreneurial environment, taking a new product from early customer learning to adoption, and applying lessons from both successful and unsuccessful experiments.
  • Hands-on prototyping with coding agents and delivery of customer-facing performance or outcome experiences.
  • Leading initiatives that require agreement across research, engineering, product, and customer-facing organizations.

What success looks like

Customers see credible improvement in real agent workflows, supported by evaluations they can trust. You independently take an initial quality problem from failure analysis through experimentation and customer validation, and deliver a focused feature with engineering. Teams make better release and investment decisions because of the evidence, product judgment, and coaching you bring.

Unleash Your Potential

When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we’ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what’s possible — for yourself, for AI, and the world.

Similar open jobs

Product manager jobs in San Francisco (481)Product manager jobs in Seattle (184)Jobs in San Francisco (11746)Jobs in Seattle (5769)