Member of Technical Staff, AI Engineering

Handshake

Where
San Francisco, CA
Type
Full time

Posted 52 days ago· Checked live at Handshake 1 hour ago

Stale: open 52 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Handshake asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Handshake's own hiring page 1 hour ago.
What is the job?
Handshake's mission is to organize expert human knowledge to advance the AI economy. Handshake AI works directly with frontier labs on their most consequential data, evaluation, and post-training challenges, building the systems that turn expert human knowledge into the data and evaluations that make frontier models better.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Handshake's mission is to organize expert human knowledge to advance the AI economy. Handshake AI works directly with frontier labs on their most consequential data, evaluation, and post-training challenges, building the systems that turn expert human knowledge into the data and evaluations that make frontier models better.

What you’ll do

  • Design and build systems that improve the quality, scale, and safety of the data Handshake generates and acquires for frontier model training—spanning synthetic data generation and data anonymization/PII removal.
  • Translate ambiguous research, partner, or compliance needs into clear hypotheses, experiments, evaluation plans, and production-quality implementations.
  • Build and improve data-processing pipelines, evaluation frameworks, benchmarks, and quality-control systems, whether the goal is generating higher-signal synthetic data or verifying that sensitive data has been properly de-identified.
  • Run fast, rigorous iteration loops: prototype, evaluate, interpret results, and turn learnings into the next system or product.
  • Partner directly with researchers, domain experts, and—where relevant—legal and compliance teams to ensure data is both high-utility and responsibly handled.
  • Identify repeatable patterns across engagements and productize them into reusable software and platforms.
  • Raise the technical bar through strong design judgment, clear communication, code quality, and mentorship.

What we’re looking for

  • 2–10 years of recent, demonstrated experience in one or more of: synthetic/LLM-generated data, post-training and model-evaluation work, privacy engineering, or data anonymization/de-identification at scale.
  • A hands-on individual contributor track record—this is not a team-lead or engineering-management role.
  • Strong Python skills and the ability to write clean, efficient, scalable software for large, messy, real-world datasets.
  • Sound judgment for reasoning about data quality, risk, and utility—forming hypotheses, choosing meaningful metrics, diagnosing failures, and distinguishing signal from noise.
  • Experience designing systems—not only implementing specifications—including tradeoffs around quality, scale, reliability, and reuse.
  • Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
  • Collaborative, low-ego communication and the ability to work effectively with researchers, engineers, domain experts, and customers.

Especially compelling experience

  • Building or operating large-scale synthetic or LLM-generated data pipelines for model training.
  • Building or operating large-scale data de-identification or anonymization systems, ideally involving relational or graph-structured data, with experience preserving referential/relationship integrity after anonymization.
  • Developing LLM/agent benchmarks, evaluation methodologies, annotation systems, or data-quality frameworks.
  • Research or applied work on reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems.
  • Prior work in a regulated or high-sensitivity data environment (healthcare, finance, HR/people data, government), or experience with re-identification risk assessment and privacy auditing.
  • Published research, meaningful open-source contributions, or evidence of technical leadership in ML systems, data engineering, or AI research.
  • Experience productizing research or repeated customer work into robust, reusable platforms.

Why join

  • Work on problems at the center of how frontier AI systems improve, alongside leading labs and domain experts.
  • Help build an early technical organization where your work shapes the roadmap, standards, and culture.
  • Move fluidly from research insight to real-world systems, with the resources and customer context to see those systems matter.
  • Join a company building durable infrastructure for careers in the AI economy.

Perks

Handshake delivers benefits that help you feel supported—and thrive at work and in life.

The below benefits are for full-time US employees.

🎯 Ownership: Equity in a fast-growing company

💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching

🍼 Family Support: Paid parental leave, fertility benefits, parental coaching

💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

📚 Growth: $2,000 learning stipend, ongoing development

💻 Office: Commuting support, free lunch, and gym in our SF office

🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days

🤝 Connection: Team outings & referral bonuses

Similar open jobs

Machine learning engineer jobs in San Francisco (584)Jobs in San Francisco (11741)