Sr. Staff Software Engineer, AI Platform

Pinterest

Where
Palo Alto, CA, US; Remote, US
Pay
$209K to $429K a year

Posted 43 days ago· Checked live at Pinterest 6 minutes ago

Stale: open 43 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Pinterest asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Pinterest's own hiring page 6 minutes ago.
What is the job?
Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.
What does it pay?
$209K to $429K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.

What you’ll do

  • Identify modernization opportunities and scale the roadmap for a company-wide evaluation system in partnership with technical leadership
  • Define cross-team technical strategy, align partner teams, and drive broad adoption of shared evaluation capabilities
  • Make durable architectural decisions that improve the user experience and reliability of Pinterest’s AI/ML evaluation platform
  • Establish evaluation methodologies and standards that balance automated metrics, expert judgment, human feedback, safety, and business outcomes
  • Lead complex cross-team workstreams, resolve technical tradeoffs and risks, and deliver impact

What we’re looking for

  • 3+ years of deep, hands-on experience designing and operating evaluation systems for GenAI and complex ML systems, including benchmark design, golden datasets, automated metrics, human evaluation, model-based grading, and failure analysis
  • Strong programming skills in Python coupled with a solid grasp of distributed systems principles, and comfortable iterating with AI tools on coding and design
  • Deep familiarity with GenAI and RecSys evaluation libraries and frameworks, AutoEvals, OpenEvals, Ragas, etc
  • 5+ years of experience building scalable platforms for distributed experimentation, data and model versioning, orchestration, observability, release management, and production monitoring
  • Strong judgment around GenAI risks, including robustness, bias, privacy, security, and the limitations of automated evaluation signals
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience

Similar open jobs

Software engineer jobs in San Jose (1462)Remote software engineer jobs (2056)Jobs in San Jose (7796)