Member of Technical Staff - Research, Inference

Modal

Where
New York
Pay
$15.75 an hour

Posted 4 months ago· Checked live at Modal 2 hours ago

Stale: open 137 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Modal asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Modal's own hiring page 2 hours ago.
What is the job?
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
What does it pay?
$15.75 an hour, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.

Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.

What you’ll work on

  • Own end-to-end inference research bets: speculative decoding, disaggregated prefill/decode, quantization (FP8, INT4), KV-cache and memory management, autoscaling for spiky serverless traffic, and whatever else the research agenda calls for
  • Train custom speculators against real production traffic and feed what you learn back into target models; acceptance length is the metric that decides the win
  • Work directly with customers alongside our Forward Deployed Engineers to deploy and tune models, and bring what you learn back into the research
  • Carry and expand collaborations with outside research labs, for example:
  • our work with ZLab on DFlash https://modal.com/blog/spec-is-all-u-need, a speculator design built on KV injection and blockwise parallel drafting
  • our work with SGLang on specdec https://modal.com/blog/host-overhead-inference-efficiency and multimodal inference https://modal.com/blog/boosting-multimodal-inference-performance-by-greater-than-10-with-a-single-python-dictionary performance
  • our work on Flash Attention 4 kernels https://modal.com/blog/flash-attention-4-faster
  • Work with engineering to turn frontier serving techniques into products: primitives for disaggregation, fast weight refresh for models that keep training after deployment, observability for quality and latency in production, or even a next-generation inference engine
  • Help shape the research agenda

None of the above is prescriptive; your work will help guide our future.

Similar open jobs

Jobs in San Francisco (11741)Jobs in New York (19148)