ML Infrastructure Engineer

Zaimler

Where
San Mateo, CA

Posted 16 months ago· Checked live at Zaimler 3 hours ago

Stale: open 485 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Zaimler asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Zaimler's own hiring page 3 hours ago.
What is the job?
AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.

What You’ll Own

  • Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data analysis and agent workflows
  • Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads
  • Optimize and improve the engine builder and model server that power scalable agent orchestration

What You Need

  • Proven ability to build scalable ML/AI platforms from scratch, end-to-end, for production use cases. You've owned a zero-to-one build before, or can show you're capable of it
  • Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving
  • Experience building distributed systems for AI/ML workloads at scale, connecting them to real product or vertical integrations
  • 3+ years of relevant experience. We care about capability, not tenure

Nice to Have

  • Ray / Ray Serve experience
  • Familiarity with AIBrix

Why Join

  • A rare chance to shape both company and product direction as an early team engineer
  • Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch
  • Onsite culture in San Mateo, built for deep collaboration and high-velocity building
  • Full benefits (medical, dental, vision, 401k)
  • We sponsor H-1B visas and assist with immigration

We value builders over résumés. If this role excites you but you don't check every box, we still want to hear from you. zaimler is an equal opportunity employer.