Sr. Staff ML Researcher, LLM Algorithmic Optimization

D Matrix

Where
Hybrid in Santa Clara

Posted 4 months ago· Checked live at D Matrix 3 hours ago

Stale: open 127 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what D Matrix asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on D Matrix's own hiring page 3 hours ago.
What is the job?
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today.

What You Will Do

  • Research and develop algorithmic and numerical techniques that improve the latency, throughput, memory efficiency, and accuracy of large language model inference on d-Matrix DNN accelerators.
  • Design and evaluate methods such as low-precision quantization, model compression, sparsity, pruning, distillation, low-rank approximation, and other techniques for efficient neural-network execution.
  • Optimize key transformer inference workloads, including matrix operations, attention mechanisms, and KV-cache utilization, based on model characteristics and hardware constraints.
  • Analyze tradeoffs among model quality, numerical precision, memory footprint, compute efficiency, and system performance.
  • Build high-quality research prototypes and evaluation frameworks in Python to test new ideas across relevant models, datasets, and workloads.
  • Partner with hardware, compiler, and software teams to map algorithms effectively to accelerator capabilities, including supported data types, memory hierarchy, data movement, and compute architecture.
  • Stay current with advances in efficient LLM inference, neural-network optimization, numerical methods, and hardware-aware machine learning, and apply relevant developments to d-Matrix products.

Similar open jobs

Machine learning engineer jobs in San Jose (445)Jobs in San Jose (7796)