Member of Technical Staff, Inference & RL Systems

Magic Dev

Where
San Francisco
Pay
$275K to $550K a year

Posted 8 months ago· Checked live at Magic Dev 2 hours ago

Stale: open 264 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Magic Dev asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Magic Dev's own hiring page 2 hours ago.
What is the job?
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone.
What does it pay?
$275K to $550K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone.

What you’ll work on

  • Design and scale high-performance inference serving systems
  • Optimize KV-cache management, batching strategies, and scheduling
  • Improve throughput and latency for long-context workloads
  • Build and maintain distributed RL and post-training infrastructure
  • Improve reliability of rollout, evaluation, and reward pipelines
  • Automate fault detection and recovery for serving and RL systems
  • Profile and eliminate performance bottlenecks across GPU, networking, and storage layers
  • Collaborate with Kernels and Research to align execution systems with model architecture

What we’re looking for

  • Strong software engineering and distributed systems fundamentals
  • Experience building or operating large-scale inference or training systems
  • Deep understanding of GPU execution constraints and memory trade-offs
  • Experience debugging performance issues in production ML systems
  • Ability to reason about system-level trade-offs between latency, throughput, and cost
  • Track record of owning critical production infrastructure

Compensation, benefits, and perks (us)

  • Annual salary range: $275K - $550K
  • Equity is a significant part of total compensation, in addition to salary
  • 401(k) plan with 6% salary matching
  • Generous health, dental and vision insurance for you and your dependents
  • Unlimited paid time off
  • Visa sponsorship and relocation stipend to bring you to SF, if possible
  • A small, fast-paced, highly focused team

Similar open jobs

Jobs in San Francisco (11741)