AI Engineer - Data and Evals

Glean

Where
San Francisco Bay Area
Pay
$200K to $280K a year

Posted 27 days ago· Checked live at Glean 33 minutes ago

Stale: open 27 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Glean asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Glean's own hiring page 33 minutes ago.
What is the job?
Glean is the Work AI platform that helps everyone work smarter with AI. What began as the industry’s most advanced enterprise search has evolved into a full-scale Work AI ecosystem, powering intelligent Search, an AI Assistant, and scalable AI agents on one secure, open platform.
What does it pay?
$200K to $280K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Glean is the Work AI platform that helps everyone work smarter with AI. What began as the industry’s most advanced enterprise search has evolved into a full-scale Work AI ecosystem, powering intelligent Search, an AI Assistant, and scalable AI agents on one secure, open platform.

About you

  • 5+ years of software engineering experience with strong Go and/or Python and backend fundamentals: APIs, data modeling, testing, and distributed pipelines. TypeScript is a plus.
  • Experience building datasets and benchmarks for LLM use-cases, RAG, or agents, including evalset curation and synthetic data generation.
  • Familiarity with eval methodologies and their tradeoffs: deterministic metrics, LLM-as-a-judge, pointwise vs pairwise grading, human labeling, and judge calibration.
  • Experience building eval or experiment infrastructure that runs reliably at scale, including CI/CD integrations and observability tooling like OpenTelemetry.
  • Strong analytical skills: you dig into traces and failure cases, write SQL, and use data and metrics to explain why quality moved.
  • Nice to have: experience with simulation environments and/or model post-training techniques.

Compensation & Benefits

The standard base salary range for this position is $200,000 - $280,000 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We offer a comprehensive benefits package including competitive compensation, Medical, Vision, and Dental coverage, generous time-off policy, and the opportunity to contribute to your 401k plan to support your long-term goals. When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipends to support your growth and wellbeing. We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.

We’re committed to building and sustaining a diverse, inclusive workplace. We strive to attract and retain people with a wide range of backgrounds, experiences, and perspectives, and we do not discriminate on the basis of gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.

Similar open jobs

Machine learning engineer jobs in San Francisco (586)Jobs in San Francisco (11750)