Member of Technical Staff - Inference Runtime

Modal

Where
San Francisco
Pay
$15.75 an hour

Posted 45 days ago· Checked live at Modal 2 hours ago

Stale: open 45 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Modal asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Modal's own hiring page 2 hours ago.
What is the job?
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
What does it pay?
$15.75 an hour, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.

Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.

What you'll work on

  • Make container startup, checkpoint, and restore dramatically faster for large inference and training workloads
  • Build multi-GPU and accelerator-aware snapshotting, including efficient handling of GPU memory and RDMA-enabled workloads
  • Design zero-copy and low-copy data paths between container memory, filesystems, storage, and Modal’s runtime
  • Optimize large snapshot pipelines using techniques such as parallel uploads, direct I/O, incremental snapshots, and more efficient memory handling
  • Improve container image and filesystem performance across EROFS, FUSE, page caches, overlay filesystems, and remote storage
  • Extend our sandboxed runtime to support new GPUs, drivers, profiling tools, and device capabilities across NVIDIA and AMD hardware
  • Debug complex failures involving system calls, virtual memory, process lifecycle, kernel behavior, GPU drivers, and container isolation
  • Safely roll out runtime and kernel changes across a heterogeneous fleet using compatibility controls, scheduling constraints, feature flags, and observability
  • Work across the runtime, scheduler, storage, and GPU infrastructure, and take ambiguous production problems from investigation through deployment

Similar open jobs

Jobs in San Francisco (11741)