Base Labs Research Scientist - RL Environments

Baseten

Where
Hybrid in San Francisco

Posted 21 hours ago· Checked live at Baseten 4 hours ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Baseten asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Baseten's own hiring page 4 hours ago.
What is the job?
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.

Responsibilities

  • Identify capabilities and failure modes worth studying, informed by real model use. These may include software development, tool use, scientific reasoning, and following complex instructions.
  • Design task distributions, interactions, rewards, and verifiers together. Establish that tasks are solvable and that success depends on the intended capability. Investigate shortcuts, ambiguous instructions, and weaknesses in grading.
  • Build methods that scale environment creation without weakening the quality standard. Study how to generate diverse tasks, calibrate difficulty, and detect defects before they spread through a large training pool.
  • Run RL experiments to measure learning and transfer. Compare curricula, task mixtures, and reward designs; investigate failed runs and unexpected behavior; test whether improvements hold on unseen tasks.
  • Develop evaluation methods that distinguish capability differences from sampling noise, grader errors, or artifacts of the agent’s tools and execution setup. Preserve the evidence needed to reproduce and challenge your conclusions.
  • Work with safety researchers on environments that reveal reward hacking and misalignment, and test ways to teach more reliable behavior.
  • Release environments, datasets, training recipes, and research findings that other teams can use. Make their assumptions, limitations, and measured effects clear.

Who we're looking for

We look for evidence that you can choose a useful research question, design an informative experiment, implement it, and reason carefully about the result.

You should bring depth in a relevant area such as reinforcement learning, model evaluation, agent systems, synthetic data, or experimental methodology. You should be comfortable writing the code needed to build environments, run experiments, and inspect failures in detail. Experience with LLM training is valuable, as is experience building something that other researchers use.

Your evidence might be a paper, an open-source project or a strong experimental investigation. We also welcome exceptional people from adjacent fields. A PhD or a previous Research Scientist title is not required.

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Similar open jobs

Machine learning engineer jobs in San Francisco (588)Machine learning engineer jobs in New York (479)Jobs in San Francisco (11766)Jobs in New York (19084)