Senior AI Engineer, Quality

Fieldguide

Where
Hybrid in San Francisco, CA or Remote (USA)
Pay
$100 an hour

Posted 7 months ago· Checked live at Fieldguide 14 minutes ago

Stale: open 213 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Fieldguide asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Fieldguide's own hiring page 14 minutes ago.
What is the job?
Fieldguide is establishing a new state of trust for global commerce and capital markets through automating and streamlining the work of assurance and audit practitioners specifically within cybersecurity, privacy, and financial audit. Put simply, we build software for the people who enable trust between businesses.
What does it pay?
$100 an hour, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Fieldguide is establishing a new state of trust for global commerce and capital markets through automating and streamlining the work of assurance and audit practitioners specifically within cybersecurity, privacy, and financial audit. Put simply, we build software for the people who enable trust between businesses.

Who you are

You are an engineer who believes that evaluations are foundational to building reliable AI systems, not a nice-to-have. The following operating principles should resonate with you:

  • Evaluation-first mindset: You understand that for an AI company, not being able to evaluate a new model quickly is unacceptable
  • AI-native instincts: You treat LLMs, agents, and automation as fundamental building blocks and parts of the craft of engineering
  • Data-driven rigor: You make decisions based on metrics and are obsessed with measuring what matters
  • Production-oriented: You understand that evaluations must work on real production behavior, not just offline datasets
  • Strong product judgment: You can decide what matters and why, without waiting for guidance, not just how to implement it
  • Bias to building: You move fast and build working systems rather than perfect specifications

Experience

We care more about capability and trajectory than years on a resume, but most strong candidates will have:

  • Multiple years of experience shipping production software in complex, real-world systems
  • Experience with TypeScript, React, Python, and Postgres
  • Built and deployed LLM-powered features serving production traffic
  • Implemented evaluation frameworks for model outputs and agent behaviors
  • Designed observability or tracing infrastructure for AI/ML systems
  • Worked with vector databases, embedding models, and RAG architectures
  • Experience with evaluation platforms (LangSmith, Langfuse, or similar)
  • Comfort operating in ambiguity and taking responsibility for outcomes
  • Deep empathy for professional-grade, mission-critical software (experience with audit and accounting workflows are not required)

Some of our benefits include

  • Competitive compensation packages with meaningful ownership
  • Flexible PTO
  • 401k
  • Wellness benefits, including a bundle of free therapy sessions
  • Technology & Work from Home reimbursement
  • Flexible work schedules

Similar open jobs

Machine learning engineer jobs in San Francisco (586)Jobs in San Francisco (11750)