Machine Learning Engineer, GeForce G-Assist

NVIDIA

Where
US, CA, Santa Clara

Posted 20 days ago· Checked live at NVIDIA 3 days ago

Stale: open 20 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what NVIDIA asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on NVIDIA's own hiring page 3 days ago.
What is the job?
At NVIDIA, we’re building GeForce G-Assist — an on-device AI assistant that combines Small Language Models (SLMs), retrieval systems, and hybrid cloud capabilities to deliver responsive, context-aware assistance inside the GeForce ecosystem. We work closely across engineering and product teams to ensure G-Assist performs reliably in real-world scenarios.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

At NVIDIA, we’re building GeForce G-Assist — an on-device AI assistant that combines Small Language Models (SLMs), retrieval systems, and hybrid cloud capabilities to deliver responsive, context-aware assistance inside the GeForce ecosystem. We work closely across engineering and product teams to ensure G-Assist performs reliably in real-world scenarios.

At NVIDIA, we’re building GeForce G-Assist — an on-device AI assistant that combines Small Language Models (SLMs), retrieval systems, and hybrid cloud capabilities to deliver responsive, context-aware assistance inside the GeForce ecosystem. We work closely across engineering and product teams to ensure G-Assist performs reliably in real-world scenarios.

What you'll be doing

  • Together, we focus on how models behave in production, not just on benchmarks. Evaluate and improve Small Language Models used in GeForce G-Assist, with an emphasis on accuracy, robustness, and conversational reliability. Identify and mitigate conversation and context contamination, including state drift, prompt leakage, and retrieval cross-talk.
  • Work with SLM and VLM architectures to support text and multimodal interactions. Collaborate on hybrid architectures that combine local SLMs with cloud-based models. We value engineers who enjoy thinking across the full system—from model behavior to runtime performance.
  • Optimize local inference using llama.cpp, including quantization, memory usage, and performance tuning. Read, write, and optimize C/C++ code in performance-critical paths.
  • Design and integrate retrieval-augmented generation (RAG) systems that ground responses in system and user context. Support agentic AI workflows, enabling planning, tool use, and multi-step execution.

What we need to see

  • 5+ years of validated experience in system software or a related field, with an M.S. or higher degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience). We’re looking for teammates who enjoy solving real problems, learning as they go, and collaborating in a tight-knit environment.
  • Strong ability to read and write C/C++ code in systems-level or performance-sensitive environments, along with proficiency in Python. Hands-on experience with llama.cpp or similar local inference frameworks.
  • Hands-on experience evaluating Small Language Models, including task-based and conversational testing, with an understanding of conversation dynamics, long-context behavior, and contamination challenges.
  • Knowledge of SLM and VLM architectures and their trade-offs, experience with retrieval technologies and language-model integration, and familiarity with agentic AI patterns such as tool use and planning.

Similar open jobs

Machine learning engineer jobs in San Jose (445)Jobs in San Jose (7796)