Software Engineer - Storage Systems (Agent Infra)

Baseten

Where
Hybrid in San Francisco

Posted 23 days ago· Checked live at Baseten 2 hours ago

Stale: open 23 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Baseten asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Baseten's own hiring page 2 hours ago.
What is the job?
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.

Responsibilities

  • Design and implement core Agent Drive features: metadata replication, volume placement, garbage collection, and FUSE client behavior
  • Solve multi-attach correctness: cache coherency across many FUSE mounts of the same drive, dentry and inode invalidation, write ordering, and crash consistency
  • Optimize tail latency on read and write paths, including page cache strategy, writeback, prefetch, and metadata RPC batching
  • Build tenant isolation into the storage layer, including quota enforcement, blast-radius containment, and noisy-neighbor mitigation
  • Own the storage side of sandbox startup and resume performance
  • Build durable block storage for sandboxes alongside other Baseten storage teams
  • Build observability into every layer, drive storage incidents end to end, and turn each one into a permanent fix
  • Contribute upstream to the open-source storage projects we build on

Requirements

  • Strong systems programming background in Go, Rust, and/or C/C++, with comfort reading kernel code
  • Deep understanding of Linux filesystem and storage internals: VFS, page cache, dentry and inode caches, FUSE, the block I/O stack, fsync semantics, and crash consistency
  • Hands-on experience building distributed storage systems, content-addressable storage, or large-scale caching infrastructure
  • Experience profiling I/O, memory, and RPC bottlenecks and optimizing tail latency in production
  • Ability to debug correctness bugs that only show up under concurrency or partial failure
  • You move fast and like owning a problem end to end on a small team

Nice to have

  • Experience with a distributed filesystem or object store such as JuiceFS, CephFS, or S3-compatible storage, or contributions to those projects
  • Knowledge of consensus and replication protocols (Raft, leader leases, quorum reads)
  • Experience with snapshot, clone, and copy-on-write filesystem features
  • Experience operating multi-tenant storage with hard isolation requirements
  • Familiarity with Linux performance tooling such as eBPF, io_uring, perf, ftrace, and blktrace

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Similar open jobs

Software engineer jobs in San Francisco (1709)Software engineer jobs in New York (1437)Jobs in San Francisco (11750)Jobs in New York (19157)