Model Operations Lead, AI Gateway

Cloudflare

Where
Location not stated
Pay
$230K to $317K a year

Posted 24 days ago· Checked live at Cloudflare 4 minutes ago

Stale: open 24 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Cloudflare asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Cloudflare's own hiring page 4 minutes ago.
What is the job?
At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.
What does it pay?
$230K to $317K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.

Responsibilities

  • Day-Zero & Quality Launches: Ensure new models launch on day zero with tested capabilities, accurate pricing, docs, and a clear call on routing eligibility.
  • Catalog Reliability & Health: Ensure the catalog reflects reality, and proactively identify when a model or provider is underperforming before customers notice.
  • Auto-Routing & Optimization: Deliver auto-routing that measurably beats a fixed model choice on cost or quality for users.
  • Developer Trust & Methodology: Build and maintain trusted rankings and recommendations grounded in solid methodology.
  • Partner & Stakeholder Management: Set clear expectations for providers, while keeping Engineering, Product, Partnerships, and other stakeholders aligned.
  • Team Leadership & Growth: Provide clear ownership and direction so the team knows what's next, who owns it, and how to grow into bigger roles.
  • Operational Scalability: Continually drive down the human effort required for each launch, eval, and routing update through tools and automation.

Desirable Skills, Knowledge, and Experience

  • People Leadership: Experience hiring, managing, and growing engineers or operators, giving direct feedback, delegating real ownership, and expanding scope without becoming a bottleneck.
  • Technical & Shipping Capabilities: Proven track record of taking technical launches or integrations from ambiguity to production across teams and partners. Hands-on ability to write TypeScript, Python, or Rust, read API docs, inspect endpoints, and debug using terminal tools (logs, cURL).
  • Model Ecosystem Expertise: Deep familiarity with new models, labs, and inference providers. Hands-on understanding of streaming, tool calling, structured outputs, rate limits, token pricing, and provider-specific model behavior variations.
  • Product & SRE Mindset: Data-driven product instincts to advocate for adding, modifying, or retiring catalog items. SRE approach to defining, measuring, and alerting on service health, managing incidents calmly, and fixing root causes.
  • Agent Workflows & Detail-Oriented Execution: Daily experience building with agents—scoping work, verifying outputs, and integrating deterministic checks or human judgment appropriately. Meticulous attention to detail regarding model IDs, context limits, per-token prices, and response fields.

Bonus Qualifications (Nice to Have)

  • Experience at an inference provider, model lab, model router, eval platform, or API company.
  • Background in evals, ranking/recommendation systems, observability, metering, or usage-based billing.
  • Familiarity with Cloudflare Workers, AI Gateway, Workers AI, or Replicate.
  • Relevant domain backgrounds in engineering management, SRE, partner engineering, evals/applied ML, technical program management, or solutions engineering.

Compensation

Compensation may be adjusted depending on work location.

  • For Bay Area based hires: Estimated annual salary of $230,000 - $317,000
  • For New York City, New Jersey, Washington, Washington DC, and California (excluding Bay Area) based hires: Estimated annual salary of $275,000 - $303,000

Equity

This role is eligible to participate in Cloudflare’s equity plan.

Benefits

Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.

Health & Welfare Benefits

  • Medical/Rx Insurance
  • Dental Insurance
  • Vision Insurance
  • Flexible Spending Accounts
  • Commuter Spending Accounts
  • Fertility & Family Forming Benefits
  • On-demand mental health support and Employee Assistance Program
  • Global Travel Medical Insurance