Research Scientist, Post-Training

Datologyai

Where
Hybrid in San Mateo HQ
Pay
$180K to $300K a year

Posted 42 days ago· Checked live at Datologyai 42 minutes ago

Stale: open 42 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Datologyai asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Datologyai's own hiring page 42 minutes ago.
What is the job?
Models are what they eat. But a large portion of training compute is wasted training on data that are already learned, irrelevant, or even harmful, leading to worse models that cost more to train and deploy. At DatologyAI, we’ve built a state of the art data curation suite to automatically curate and optimize petabytes of data to create the best possible training data for your models.
What does it pay?
$180K to $300K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Models are what they eat. But a large portion of training compute is wasted training on data that are already learned, irrelevant, or even harmful, leading to worse models that cost more to train and deploy.

At DatologyAI, we’ve built a state of the art data curation suite to automatically curate and optimize petabytes of data to create the best possible training data for your models.

What you'll work on

  • Post-training data curation. You’ll conduct research on how to algorithmically curate post-training data—e.g., how to generate and refine preference and instruction-following data, how to curate capability- and domain-specific data, and make post-training more effective, controllable, and generalizable.
  • Unifying pre-training and post-training data curation. Pushing the bounds on model capabilities requires unifying post-training and pre-training data curation. You will pursue research on end-to-end data curation: how to curate pre-training data to improve the post-trainability of models and how to jointly optimize pre- and post-training data curation, all in service of maximizing the final performance of post-trained models.
  • Transform messy literature into practical improvements. The research literature is vast, rife with ambiguity, and constantly evolving. You will use your skills as a scientist to source, vet, implement, and improve promising ideas from the literature and of your own creation.
  • Conduct science driven by real-world needs. At DatologyAI, we understand that conference reviewers and academic benchmarks don’t always incentivize the most impactful research. Your research will be guided by concrete customer needs and product improvements.

About you

  • 3+ years of deep learning research experience
  • Experience with post-training large vision, language, and multimodal models
  • Post-training algorithm development, data curation, and/or synthetic data methods for:
  • Preference-based tuning (e.g. DPO, RLVR, RRHF)
  • Alternative supervision & self-supervision techniques such as self-training and chain-of-thought distillation
  • SFT (e.g. instruction tuning and demonstration fine-tuning)
  • Post-training tooling development and engineering experience
  • Strong understanding of the fundamentals of deep learning
  • Sufficient software engineering + deep learning framework (PyTorch or a willingness to learn PyTorch) skills to conduct large-scale research experiments and build production prototypes.
  • Demonstrated track record of success in deep learning research, whether papers, tools, or other research artifacts.

Nice to have

  • Experience with data management and distributed data processing solutions (e.g. Spark, Snowflake, etc.)
  • Experience building + shipping ML products

Candidates do not need a PhD or extensive publications. Some of the best researchers we’ve worked with have no formal training in machine learning, and obtained all of their experience by working in industry and building products. We believe that adaptability, combined with exceptional communication and collaboration skills are the most important ingredients for successful research in a startup environment.

Compensation

At DatologyAI, we are dedicated to rewarding talent with competitive salary and meaningful equity. The salary for this position ranges from $180,000 to $300,000.

  • Starting pay is based on job-related skills, experience, qualifications, and interview performance.

Benefits

  • 100% covered health benefits (medical, vision, and dental).
  • 401(k) plan with a generous 4% company match.
  • Unlimited PTO policy
  • Paid Parental Leave of 12 weeks, plus 6 months of WFH flexibility.
  • Annual $2,000 wellness stipend.
  • Annual $1,000 learning and development stipend.
  • Daily lunches and snacks are provided in our office!
  • Relocation assistance for employees moving to the Bay Area.