Senior/Staff Software Engineer, Distributed Systems

Hedra

Where
San Francisco

Posted 6 months ago· Checked live at Hedra 33 minutes ago

Stale: open 181 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Hedra asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Hedra's own hiring page 33 minutes ago.
What is the job?
Hedra is a research and infrastructure lab advancing post-training and inference for multimodal and physical AI. Our ambition is to bring recursive self-improvement to models that learn from and interact with the real world. We combine reinforcement learning research with GPU compute and optimized inference to help teams post-train, serve and continuously improve models they own.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Hedra is a research and infrastructure lab advancing post-training and inference for multimodal and physical AI. Our ambition is to bring recursive self-improvement to models that learn from and interact with the real world.

We combine reinforcement learning research with GPU compute and optimized inference to help teams post-train, serve and continuously improve models they own.

What you’ll do

  • Design, build, and operate distributed systems that power Hedra’s inference infrastructure.
  • Build systems for scheduling, routing, and managing compute-intensive workloads across heterogeneous resources.
  • Improve throughput, latency, reliability, and resource utilization across our serving infrastructure.
  • Design systems that remain predictable and resilient under load, partial failures, changing capacity, and unpredictable workloads.
  • Own production systems end to end, including deployment, CI/CD, testing and validation, observability, monitoring, alerting, debugging, and incident response.
  • Identify architectural bottlenecks and failure modes and drive solutions rather than waiting for problems to be fully specified.
  • Work across infrastructure, model serving, APIs, and developer-facing systems as the platform evolves.
  • Use modern agentic coding workflows as part of how you design, build, debug, and ship software.
  • Help shape the technical direction of a small engineering organization where individual engineers have substantial ownership.

What we’re looking for

  • 5+ years of software engineering experience, with significant experience building distributed backend or infrastructure systems.
  • A track record of designing and operating high-availability production services at meaningful scale.
  • Strong distributed systems fundamentals, including experience reasoning about concurrency, queues, retries, failure recovery, consistency, backpressure, capacity, and system behavior under load.
  • Experience debugging complex production systems across multiple layers of the stack.
  • Strong judgment around architectural tradeoffs, particularly reliability, performance, complexity, and operational cost.
  • Experience with CI/CD, comprehensive testing and validation strategies, monitoring, alerting, and production operations.
  • Strong programming fundamentals and experience working in systems-oriented backend languages. Python experience is helpful given our stack.
  • Experience using agentic coding tools and workflows beyond basic prompting.
  • Comfort operating in an environment where problems are often underspecified and engineers are expected to independently determine the right approach.
  • Ability to communicate technical decisions clearly and collaborate with engineers across infrastructure, research, and product.

Nice to have

  • Experience with inference or model-serving infrastructure.
  • GPU or accelerator infrastructure.
  • Compute scheduling, orchestration, or resource management.
  • High-throughput or low-latency systems.
  • Kubernetes or other cluster orchestration systems.
  • Performance optimization and profiling.
  • Developer infrastructure, APIs, SDKs, or platform engineering.
  • Experience operating infrastructure across cloud and/or bare-metal environments.

Benefits

  • Competitive compensation and equity
  • 401k
  • Healthcare (Silver PPO Medical, Vision, Dental)
  • Lunch and snacks at the office

This role is based in San Francisco, and we work together in person five days a week.

Similar open jobs

Software engineer jobs in San Francisco (1709)Jobs in San Francisco (11750)