SRE, AI Inference Engineer

F5, Inc. (United States)

Where
San Jose
Pay
$177K to $265K a year

Posted 2 months ago· Checked live at F5, Inc. (United States) 4 days ago

Stale: open 70 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what F5, Inc. (United States) asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on F5, Inc. (United States)'s own hiring page 4 days ago.
What is the job?
At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.
What does it pay?
$177K to $265K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.

Required Skills

  • Programming Languages: Proficiency in programming languages such as Python, C++, Rust, or Golang specifically for high-performance AI workflows.
  • Inference Tools: Proven hands-on experience with tools like vLLM, TensorRT, Llama.cpp, and Ollama for inference development and optimization.
  • Infrastructure Expertise: Strong familiarity with infrastructure technologies, including Docker, Kubernetes, and cloud platforms such as AWS, GCP, and Azure.
  • Hardware Optimization Expertise: Comprehensive understanding of GPU and AI hardware, including techniques for profiling and optimizing performance for accelerators like NVIDIA GPUs and TPUs.

Preferred Experience

  • Prior experience deploying Large Language Models (LLMs) with advanced techniques like Speculative Decoding or PagedAttention.
  • Contributions to open-source inference libraries or hardware-level kernel development (e.g., CUDA, Triton kernels).
  • Background in MLOps or SRE roles focused on high-performance AI endpoints and reliability during demand surges.
  • Proficiency in designing scalable solutions for high-throughput inference environments optimized for traffic bursts.

Why Join F5?

F5 empowers you to push boundaries in AI optimization and high-performance engineering. Joining our team means:

  • Collaborating with cutting-edge technologies and hardware solutions to support real-time AI applications.
  • Advancing your career in a fast-paced, multidisciplinary environment focused on innovation, scalability, and problem-solving.
  • Driving transformative projects that deliver real-time AI reliability to global customers while maintaining cost and efficiency standards.
  • Working on advanced MLOps solutions that seamlessly scale enterprise AI systems and shape the future of intelligent deployment.

Similar open jobs

Machine learning engineer jobs in Seattle (184)Machine learning engineer jobs in San Jose (445)Jobs in Seattle (5774)Jobs in San Jose (7798)