Principal Software Engineer, Inference

hpe

Where
Spring, Texas, United States of America

Posted 13 days ago· Checked live at hpe 3 days ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what hpe asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on hpe's own hiring page 3 days ago.
What is the job?
Principal Software Engineer, Inference This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

Principal Software Engineer, Inference

This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work.

Responsibilities

  • Define and own the technical direction of the LLM serving deployment, i ncluding engine integration, continuous batching, KV cache management and reuse, and quantized execution
  • Partner with inference performance engineering teams, with accountability for time-to-first-token, inter-token latency, throughput per GPU, and P95/P99 tail latency
  • Define distributed inferencing strategy, including disaggregated prefill/decode, tensor and pipeline parallelism, KV cache offload across GPU memory, host memory, and RDMA-attached storage
  • Evaluate emerging runtimes, quantization schemes, speculative decoding, and mixture-of-experts serving, and determine whether each runtime is adopted, developed in-house, or declined
  • Define the orchestration layer supporting the runtime, including model admission, GPU scheduling and partitioning, cache-aware request routing, and autoscaling
  • Mentor engineers, lead design and architecture reviews, and present technical direction to business unit and executive audiences

Preferred

  • Upstream contribution to vLLM, SGLang, TensorRT-LLM, LLM-D, LMCache, or KServe
  • Disaggregated prefill/decode serving, or KV cache offload and reuse at scale
  • RDMA, GPUDirect Storage, InfiniBand, or RoCE
  • MIG, fractional GPU allocation, and multi-tenant GPU isolation
  • On-premises, air-gapped, or regulated enterprise software delivery

Experience and Education

  • Minimum of 12 years of experience in Software Engineering, including +1 years working directly on LLM inference runtimes or production model serving
  • Degree in Computer Science or related field

Accessibility

HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here.

Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.