Research Scientist - RL Training

Snorkel AI

Where
Hybrid in New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
Pay
$200K to $375K a year

Posted 5 months ago· Checked live at Snorkel AI 19 minutes ago

Stale: open 174 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Snorkel AI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Snorkel AI's own hiring page 19 minutes ago.
What is the job?
Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems.
What does it pay?
$200K to $375K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems.

Main responsibilities

  • Research and implement cutting-edge reinforcement learning algorithms and training recipes for large language models, adapting and extending methods such as GRPO for complex, multi-turn, and long-horizon tasks; evaluate their effects on learning, generalization, and performance across diverse environments.
  • Design and build data pipelines that generate high-quality training signals for RL workflows, including AI-assisted data annotation and curation data pipelines to improve model generalization to unseen benchmarks.
  • Prototype and iterate on end-to-end RL training recipes, using training and evaluation results to identify what improves performance and where tasks, environments, or training signals need to change.
  • Work with research scientists, ML engineers, data teams, and delivery teams to diagnose training results, turn findings into actionable improvements to data and environments, and validate those improvements in subsequent training runs.
  • Stay current with advances in large-scale distributed LLM training and scalable RL, and apply relevant methods to our training systems and challenging environments, including tool-use and other complex tasks.
  • Contribute to Snorkel's research publications and internal knowledge base in RL and model training.

Preferred qualifications

  • Deep expertise in reinforcement learning for language models, including policy optimization, credit assignment, and learning from sparse or delayed rewards; experience designing or adapting methods for multi-turn and long-horizon tasks.
  • Experience training or fine-tuning 30B+ large language models at scale, including familiarity with distributed training infrastructure.
  • Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace and hands-on experience with RL frameworks such as Verl.
  • Strong software engineering skills, with a track record of building research systems and training pipelines that others can run, extend, and maintain.
  • Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.); experience with large-scale RL training pipelines a strong plus.
  • Ability to analyze training behavior and evaluation results, identify likely causes of failures or regressions, and turn findings into concrete improvements to training methods, tasks, environments, or data.
  • Ph.D. in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered.

Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.

Salary range(s) for this role

$200,000 - $375,000 USD

Be Your Best at Snorkel

Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.

Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Similar open jobs

Machine learning engineer jobs in San Francisco (584)Machine learning engineer jobs in New York (477)Jobs in San Francisco (11741)Jobs in New York (19148)