Senior Math Libraries Engineer - Sparsity in AI

NVIDIA

Where
US, CA, Santa Clara

Posted 20 days ago· Checked live at NVIDIA 3 days ago

Stale: open 20 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what NVIDIA asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on NVIDIA's own hiring page 3 days ago.
What is the job?
We are looking for software engineers to contribute to the design and development of libraries and tools to simplify and accelerate computing for unstructured sparsity in DL and HPC. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs and high-performance linear algebra libraries.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

We are looking for software engineers to contribute to the design and development of libraries and tools to simplify and accelerate computing for unstructured sparsity in DL and HPC. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs and high-performance linear algebra libraries.

We are looking for software engineers to contribute to the design and development of libraries and tools to simplify and accelerate computing for unstructured sparsity in DL and HPC. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs and high-performance linear algebra libraries. Applications of these technologies include LLMs, computer aided engineering, quantum chemistry, autonomous vehicles, computer vision, and countless others. Did you know our team develops the GPU accelerated libraries and SDKs that help make these possible?

In this role, you will work together with other developers on developing solutions that involve generalizations to sparse tensor computations, domain specific language (DSL) specifications of sparse storage formats, and on-demand code generation. Ideal candidates will not only have experience developing accelerated computing software, but also be motivated to advance the state-of-the-art in a variety of accelerated computing domains and DL frameworks like PyTorch. If this sounds exciting, we would love to meet you!

What you will be doing

  • Design and develop a C++-based system to simplify and accelerate computing for unstructured sparsity in DL and HPC on NVIDIA GPUs
  • Enable the system in languages and frameworks that are more commonly used in DL, such as Python and PyTorch
  • Evaluate and improve the performance of the system on real-life applications
  • Realize opportunities to improve library quality, performance and maintainability by writing effective and well-tested code for production use
  • Work closely with product management and other internal and external partners to understand feature and performance requirements and contribute to technical roadmaps

What we need to see

  • BS, MS or PhD degree in Computer Science, Applied Math, or related field (or equivalent experience)
  • 6+ years of overall experience in developing, debugging and optimizing high-performance software using C++ and parallel programming; ideally for sparse linear algebra applications and using CUDA, MPI, OpenMP, or equivalent technologies
  • Experience with domain-specific language design and compiler optimizations, in particular sparse compilers (MLIR or TACO)
  • Excellent C++, Python, and CUDA programming skills
  • Strong collaboration, communication, and documentation habits and ideally experience with working in a globally distributed organization

Similar open jobs

Jobs in San Jose (7796)