Member of Technical Staff - Workers AI Applied Research

Cloudflare

Where
Hybrid
Pay
$194K to $266K a year

Posted 4 months ago· Checked live at Cloudflare 36 minutes ago

Stale: open 133 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Cloudflare asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Cloudflare's own hiring page 36 minutes ago.
What is the job?
At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.
What does it pay?
$194K to $266K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.

Responsibilities

  • Develop, optimize, and productionize machine learning models for Cloudflare’s serverless inference platform, with a focus on performance, reliability, and model quality.
  • Build benchmarking and evaluation frameworks to measure latency, throughput, cost efficiency, and model behavior across LLMs, speech, vision, and other model families.
  • Improve inference performance through quantization, batching, caching, model compilation, runtime tuning, and accelerator-aware optimization.
  • Partner with systems engineers to integrate models into Cloudflare’s distributed inference infrastructure across a heterogeneous fleet of GPUs and next-generation accelerators.
  • Drive improvements to model deployment workflows, including validation, rollout safety, observability, regression testing, and operational readiness.
  • Collaborate with product and engineering teams to translate customer requirements into scalable ML capabilities for Workers AI.
  • Mentor engineers, contribute to technical direction, and raise the quality bar for production ML engineering practices across the team.

Desirable Skills, Knowledge, and Experience

  • Experience building, optimizing, and operating machine learning models in production environments.
  • Strong proficiency with Python and modern ML frameworks such as PyTorch, TensorFlow, JAX, or equivalent.
  • Hands-on experience with inference optimization techniques for large-scale models, including quantization, batching, caching, compilation, and serving runtime tuning.
  • Experience with large-scale inference serving frameworks or runtimes such as SGLang, vLLM, TensorRT-LLM, ONNX Runtime, Triton, llama.cpp, or similar.
  • Familiarity with LLMs, speech models, vision models, embeddings, multimodal models, retrieval-augmented generation, or other modern deep learning architectures.
  • Experience optimizing models for GPUs or specialized accelerators.
  • Strong understanding of production ML concerns, including evaluation, monitoring, model regressions, rollout safety, and reliability.
  • Ability to work across ML and systems boundaries, including familiarity with distributed systems, networking, or serverless platforms.
  • Track record of leading complex technical projects and mentoring other engineers.

Bonus Points

  • Experience contributing to open source ML tooling, model serving frameworks, or inference runtimes.

Compensation

Compensation may be adjusted depending on work location.

  • F or Bay Area based hires: Estimated annual salary of $194,000 - $266,000
  • For New York City, New Jersey, Washington, Washington DC, and California (excluding Bay Area) based hires: Estimated annual salary of $185,000 - $254,000

Equity

This role is eligible to participate in Cloudflare’s equity plan.

Benefits

Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.

Health & Welfare Benefits

  • Medical/Rx Insurance
  • Dental Insurance
  • Vision Insurance
  • Flexible Spending Accounts
  • Commuter Spending Accounts
  • Fertility & Family Forming Benefits
  • On-demand mental health support and Employee Assistance Program
  • Global Travel Medical Insurance