Principal Applied Scientist

Robots and Pencils

Where
US Remote
Pay
$300K a year

Posted 7 days ago· Checked live at Robots and Pencils 2 hours ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Robots and Pencils asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Robots and Pencils's own hiring page 2 hours ago.
What is the job?
We're looking for a Principal Applied Scientist to lead the design and build of an evaluation framework for an enterprise planner-based agent. You will work directly with the client's engineering team to benchmark their agent across planner models, executor LLMs and inference optimization levers.
What does it pay?
$300K a year, as the posting states.
Our verdict
Live. Open on the employer's own site.

What the job is

We're looking for a Principal Applied Scientist to lead the design and build of an evaluation framework for an enterprise planner-based agent. You will work directly with the client's engineering team to benchmark their agent across planner models, executor LLMs and inference optimization levers.

Helpful Extras and Unique Skills

  • Publications or open-source contributions in LLM evaluation, agents or efficient inference
  • Experience building internal dashboards or web UIs that a client team can adopt as their own
  • Hands-on use of an LLM gateway or tracing stack, such as LangFuse or LangSmith, to attribute cost and latency at the request level
  • Experience in a regulated or high-stakes enterprise domain where evaluation rigor carries real consequences
  • A point of view on cost-quality tradeoffs gained from running them in production rather than reading about them

Our salary range is $200,00 - $300,000