Software Engineer, ML Infrastructure

Arc Institute

Where
Palo Alto, CA
Pay
$191K to $237K a year

Posted 37 days ago· Checked live at Arc Institute 1 hour ago

Stale: open 37 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Arc Institute asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Arc Institute's own hiring page 1 hour ago.
What is the job?
Arc Institute is an independent nonprofit research organization at the interface of artificial intelligence and biology, working to accelerate scientific progress and understand the root causes of complex diseases. Founded in 2021 and based in Palo Alto, Arc partners with Stanford University, UC Berkeley, and UC San Francisco. Unlike academia, our scientists have long-term funding and industry-like resources.
What does it pay?
$191K to $237K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Arc Institute is an independent nonprofit research organization at the interface of artificial intelligence and biology, working to accelerate scientific progress and understand the root causes of complex diseases. Founded in 2021 and based in Palo Alto, Arc partners with Stanford University, UC Berkeley, and UC San Francisco.

Unlike academia, our scientists have long-term funding and industry-like resources.

About you

  • You finish what you own, and you fix what's broken without being asked.
  • You're curious about the biology, enough to learn single-cell perturbation data and argue about what an eval should measure.
  • You're steady when priorities shift. Research is high-risk, so you test ideas early and change course when the evidence says to.
  • You don't wait on scarce expert time. If proving a dataset's value means running the model evals yourself, you run them.

In this position you will

  • Own how Arc measures the performance of its virtual cell models, starting with the backend of our Model Performance Dashboard, which you'll take over within your first two months.
  • Decide with the ML team which evaluation tools they need, then design and build them so researchers can evaluate and compare models themselves, and measure what each dataset version does to model performance.
  • Redesign the pipeline that turns single-cell data into training sets for our virtual cell models, then run it with AI agents: agents find, process and curate datasets, and automated quality checks, not manual review, decide whether a dataset version is ready for model training.
  • Own the lab-in-the-loop infrastructure that turns model performance results into the case for what Arc's labs should test next, working directly with the science leads who design those experiments.
  • Build or buy validation frameworks (tests, evals, QC gates, policies) that let agent-written code and apps ship without line-by-line human review. Start with our team, where you'll also own how we work with coding agents, then extend them to apps that scientists across Arc build themselves.
  • Own the engineering that makes the ML team's training and evaluation run fast, reliably and at scale. The ML team owns the research and the models. Once a model is ready to push, it enters the train-and-eval CI system you own, which feeds our Model Performance Dashboard. You'll also make multi-node training a supported path, track down distributed-training failures, and measure and raise throughput and GPU utilization (MFU) on clusters that Arc IT operates.

Requirements

  • Bachelor’s degree with 8 years of relevant experience, or Master’s degree with 6 years of relevant experience.
  • You've owned a production data or ML platform that researchers depend on, end to end (pipelines, storage, versioning), and set its technical direction.
  • You design and build systems with AI tools and agents, and you make their output verifiable with evals, QC gates or tests before anyone relies on it.
  • You've learned an unfamiliar technical domain well enough to make design calls in it.
  • You work directly with stakeholders to find requirements, with no PM in between.
  • You make the people around you better through code review, pairing and writing patterns down.
  • You've diagnosed and fixed performance problems in Python or PyTorch systems with profilers and measurements: GPU utilization, memory, data loading.
  • Work onsite in our Palo Alto office at least 3 days a week.

Preferred Qualifications

  • You've worked with single-cell or perturbation data (AnnData/h5ad).
  • You've built or run model evaluations: benchmarks, eval harnesses, PyTorch/GPU inference.
  • You've run multi-node distributed training (DDP/FSDP, NCCL, SLURM) or raised a training job's throughput. This is a plus, not a requirement: we care more that you learn it fast with agents and show the numbers moved.
  • You've led an effort with one or two other engineers.

The base salary range for this position is $ 191,000 to $237,000. These amounts reflect the range of base salary that the Institute reasonably would expect to pay a new hire or internal candidate for this position. The actual base compensation paid to any individual for this position may vary depending on factors such as experience, market conditions, education/training, skill level, and whether the compensation is internally equitable, and does not include bonuses, commissions, differential pay, other forms of compensation, or benefits. This position is also eligible to receive an annual discretionary bonus, with the amount dependent on individual and institute performance factors.

In addition to the Base Salary and Annual Bonus above, you will be eligible to participate in the Institute’s Compound Cash Grant Program (the “CCGP”). The CCGP is a program designed to offer multi-year cash grants providing for a fixed dollar amount paid out in semi-annual installments to reward employees for staying and contributing to the Institute. As soon as reasonably practical after your start date, you will receive a grant letter describing the terms of your award under the CCGP.

Similar open jobs

Software engineer jobs in San Jose (1462)Jobs in San Jose (7796)