Member of Technical Staff - Evaluations

Liquid Ai

Where
Hybrid in San Francisco
Type
Full time

Posted 9 days ago· Checked live at Liquid Ai 1 hour ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Liquid Ai asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Liquid Ai's own hiring page 1 hour ago.
What is the job?
Role: Member of Technical Staff - Evaluations Team: Post-Training
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

Role: Member of Technical Staff - Evaluations

Team: Post-Training

Location: San Francisco

Location Type: Hybrid

Employment Type: Full-time

Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from data center accelerators to on-device hardware, ensuring low latency, minimal memory usage, privacy, and reliability.

The work

  • Work on the internal eval suite and infrastructure: keep it reliable, optimized, and reproducible at scale.
  • Design held-out evals for priority capabilities such as agentic workflows, computer use, and cybersecurity, with documented construction and contamination checks.
  • Build evals targeted at small edge models, where most public evaluations built for frontier models don't apply.
  • Read generated outputs to debug unexpected scores before anyone acts on them.
  • Turn customer and open-source feedback into environments usable for data, training, and evaluation, and partner with other teams to design evals for their specific needs.
  • Release open-source evals, write papers about them, and publish failure-mode reviews of popular evaluations.

What we offer

  • Evals are the job: You work on the whole eval function alongside one engineer, not one benchmark inside a large eval org, with real compute to run evals at scale and a hiring manager with a large public following who wants to open-source and publish the work.
  • Compensation & Equity: Competitive base salary plus equity, so you share in what we build. Final offers reflect skills, experience, and location.
  • Time Off: Unlimited PTO, plus company-wide Refill Days, long weekends when the whole company rests together.
  • Health & Wellbeing: Comprehensive health coverage, with details varying by location.
  • Paid Leave: Paid leave for pregnancy, parenting, medical needs, and caring for family.

Similar open jobs

Jobs in San Francisco (11741)