Applied Machine Learning Engineer

Inference

Where
San Francisco
Pay
$220K to $320K a year

Posted 10 months ago· Checked live at Inference 2 hours ago

Stale: open 317 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Inference asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Inference's own hiring page 2 hours ago.
What is the job?
Help us build the systems that train specialized AI models for the fastest-growing companies in the world. If you love taking cutting-edge ML techniques and turning them into products that ship, we'd love to meet you. Inference.net http://Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost.
What does it pay?
$220K to $320K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Help us build the systems that train specialized AI models for the fastest-growing companies in the world. If you love taking cutting-edge ML techniques and turning them into products that ship, we'd love to meet you.

Inference.net http://Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost.

Key Responsibilities

  • Lead projects from from data intake through the full training pipeline, including processing, cleaning, and preparing datasets for model training
  • Build and maintain data processing pipelines for aggregating, transforming, and validating training data
  • Create dashboards and visualization tools to display training metrics, data quality, and model performance
  • Train models using our internal frameworks and iterate based on evaluation results
  • Develop robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance
  • Build systems to automate portions of the training workflow, reducing manual intervention and improving consistency
  • Take research features and ship them into production settings
  • Apply the latest techniques in SFT, RL, and model optimization to improve training quality and efficiency
  • Collaborate with infrastructure engineers to scale training across our GPU fleet
  • Deeply understand customer use cases to inform training strategies and surface edge cases

Requirements

  • 2+ years of experience training AI models using PyTorch
  • Hands-on experience with post-training LLMs using SFT or RL
  • Strong understanding of transformer architectures and how they're trained
  • Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Axolotl, or similar)
  • Experience training on NVIDIA GPUs
  • Strong data processing skills and comfortable building ETL pipelines and working with large datasets
  • Track record of creating benchmarks and evaluations
  • Ability to take research techniques and apply them to production systems

Nice-to-Have

  • Experience with model distillation or knowledge transfer
  • Experience building dashboards and data visualization tools
  • Familiarity with vision encoders and multimodal models
  • Experience with distributed training at scale
  • Contributions to open-source ML projects

You don't need to tick every box. Curiosity and the ability to learn quickly matter more.

Compensation

We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $220,000 - $320,000, plus equity and benefits, depending on experience.

Similar open jobs

Machine learning engineer jobs in San Francisco (586)Jobs in San Francisco (11750)