Applied AI Engineer, Evals
Sable
- Where
- San Francisco
Posted 2 months ago· Checked live at Sable 3 hours ago
Stale: open 64 daysUp for more than two weeks. It may already be filled.
See how you score for this job
One sentence and your resume. We score it against what Sable asks for, line by line.
See my score- Is this job still open?
- Yes. We checked it live on Sable's own hiring page 3 hours ago.
- What is the job?
- Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call.
- What does it pay?
- The posting doesn't say.
- Our verdict
- Stale. Up for more than two weeks. It may already be filled.
What the job is
Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call.
What you'll do
- Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models
- Build and maintain our internal benchmarks and simulations
- Work on systems to score customer-specific scenarios and identify gaps in current capabilities.
Who you are
- Engineer with statistics and/or applied machine learning experience
- Comfortable in a production codebase
- Bonus: prior experience with evaluations or with voice, realtime, or browser use/computer use agents.
About sable
Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call.
The role
You translate what makes a good performance into clear, defensible signals, and use those signals to improve Aidan. Role involves carrying out evaluations of agents on a broad range of areas on the frontier including voice, vision, and browser use, and using the findings to optimize the agent, context, and models.
What you'll do
- Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models
- Build and maintain our internal benchmarks and simulations
- Work on systems to score customer-specific scenarios and identify gaps in current capabilities.
Who you are
- Engineer with statistics and/or applied machine learning experience
- Comfortable in a production codebase
- Bonus: prior experience with evaluations or with voice, realtime, or browser use/computer use agents.
Similar open jobs
Machine learning engineer jobs in San Francisco (586)Jobs in San Francisco (11750)