Senior Systems Engineer, Workers AI

Cloudflare

Where
Location not stated
Pay
$194K to $266K a year

Posted 7 months ago· Checked live at Cloudflare 2 minutes ago

Stale: open 232 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Cloudflare asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Cloudflare's own hiring page 2 minutes ago.
What is the job?
At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.
What does it pay?
$194K to $266K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.

Responsibilities

  • Platform Architecture: Develop and maintain core components of the serverless inference platform to ensure high availability and scalability for Cloudflare users.
  • Optimization & Performance: Optimize the model scheduling system to significantly increase efficiency and resource utilization across our inference infrastructure, and implement improvements to request routing logic to reduce latency for end-users.
  • System Reliability: Drive significant, measurable improvements in the platform's reliability and resilience by identifying and mitigating systemic risks.
  • Observability: Expand and refine the observability stack (metrics, logging, tracing) and fine-tune alerts to proactively identify and resolve production issues.
  • Technical Leadership: Lead complex, cross-functional technical projects from initial concept and design through final deployment and operationalization.
  • Mentorship: Act as a mentor to junior engineers and actively contribute to cultivating a strong, collaborative engineering culture within the team.

Desirable skills, Knowledge & Experience

  • Proven experience in systems engineering, with a primary focus on distributed, high-performance systems.
  • Expert proficiency in Rust programming, particularly in an asynchronous environment.
  • Deep understanding and hands-on experience with relevant networking and application protocols (e.g., TCP, HTTP, WebSocket).
  • Solid experience with scaling and performance optimization techniques, including load balancing and caching in a distributed environment.

Bonus Points

  • Demonstrable experience with container orchestration platforms, specifically Kubernetes and/or Nomad.
  • Familiarity with the unique architectural challenges involved in large-scale inference serving (e.g., LLMs and diffusion models).

Compensation

Compensation may be adjusted depending on work location.

  • For Bay Area based hires: Estimated annual salary of $194,000 - $266,000
  • For New York City, New Jersey, Washington, Washington DC, and California (excluding Bay Area) based hires: Estimated annual salary of $185,000 - $254,000

Equity

This role is eligible to participate in Cloudflare’s equity plan.

Benefits

Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.

Health & Welfare Benefits

  • Medical/Rx Insurance
  • Dental Insurance
  • Vision Insurance
  • Flexible Spending Accounts
  • Commuter Spending Accounts
  • Fertility & Family Forming Benefits
  • On-demand mental health support and Employee Assistance Program
  • Global Travel Medical Insurance