Member of Technical Staff - Inference

Hyperbolic

Where
San Francisco, CA

Posted 2 months ago· Checked live at Hyperbolic 3 hours ago

Stale: open 71 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Hyperbolic asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Hyperbolic's own hiring page 3 hours ago.
What is the job?
Join us in putting the world’s compute behind the people building what comes next. At Hyperbolic, we’re making global AI compute liquid. We bring fragmented, heterogeneous GPU capacity together into one unified, productive platform, making it easier to access, sell, resell, manage, and orchestrate the resources that power AI.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Join us in putting the world’s compute behind the people building what comes next.

At Hyperbolic, we’re making global AI compute liquid. We bring fragmented, heterogeneous GPU capacity together into one unified, productive platform, making it easier to access, sell, resell, manage, and orchestrate the resources that power AI.

Who you are

  • Strong general inference background with a broad, high-level command of the stack rather than a narrow specialty — you can reason about the whole path from request to token
  • Deep Kubernetes experience, including hands-on ability to operate clusters in production, not just deploy to them
  • Solid grasp of the concepts that govern inference performance: TTFT, disaggregated inference, speculative decoding, and KV cache and its inner workings
  • Familiarity with modern inference frameworks and serving engines, and the judgment to evaluate and select among them for a given workload
  • Working knowledge of NVIDIA Dynamo and how it fits into a distributed serving architecture
  • Experience setting up monitoring, gateways, and endpoints for production inference services
  • Proven ability to build a product end to end — you've taken something from nothing to serving real traffic
  • Strong self-initiative and comfort operating as the primary owner of an area with minimal direction
  • Generalist instincts: you're willing to pick up adjacent work when it's what the product needs

Preferred qualifications

  • Experience spanning both inference deployment and inference optimization
  • Hands-on model optimization work — quantization, batching strategies, kernel-level tuning, or similar
  • Understanding of RDMA and high-performance networking as they apply to distributed serving
  • Experience deploying inference across heterogeneous accelerators
  • Background supporting customers directly on inference debugging and performance issues
  • Experience at a GPU cloud, inference provider, or AI infrastructure company

Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Similar open jobs

Jobs in San Francisco (11741)