Machine Learning Engineer, Ops

Cantina

Where
Remote (Europe)

Posted 3 months ago· Checked live at Cantina 2 hours ago

Stale: open 114 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Cantina asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Cantina's own hiring page 2 hours ago.
What is the job?
Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

What you’ll do

  • Build and optimize streaming inference engines for TTS and ASR models, including multi-stage model pipelines.
  • Optimize latency (time to first chunk, p50/p99) and throughput using continuous batching, CUDA Graphs, torch.compile and mixed precision.
  • Maintain numerical parity with the reference implementation through automated accuracy regression tests, per stage and end to end.
  • Deploy and operate GPU inference services on Kubernetes: autoscaling, containerization and infrastructure as code.
  • Build CI/CD for model artifacts, with model versioning and reproducible releases.
  • Own observability and performance benchmarking: p50/p99 latency, real-time factor (RTF), GPU utilization and cost per request.
  • Partner with research to productionize new models.

Compensation

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for u.s.-based roles

  • Competitive salary and generous company equity
  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
  • 42 days of paid time off, including:
  • 15 PTO days
  • 10 sick days
  • 15 company holidays
  • 2 floating holidays
  • Generous parental leave & fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account – $500/month to use however you’d like
  • Complimentary lunch and snacks for in-office employees
  • One Medical membership, and more!

Similar open jobs

Remote machine learning engineer jobs (519)