Senior Deep Learning Scientist, Multimodal Agentic RL
NVIDIA
- Where
- US, CA, Santa Clara
Posted 20 days ago· Checked live at NVIDIA 3 days ago
Stale: open 20 daysUp for more than two weeks. It may already be filled.
See how you score for this job
One sentence and your resume. We score it against what NVIDIA asks for, line by line.
See my score- Is this job still open?
- Yes. We checked it live on NVIDIA's own hiring page 3 days ago.
- What is the job?
- NVIDIA is widely regarded as one of the technology industry’s most desirable employers. We lead the way in High-Performance Computing, Artificial Intelligence, and Visualization. Our core invention, the GPU, serves as the visual cortex of modern computers and powers our entire product suite.
- What does it pay?
- The posting doesn't say.
- Our verdict
- Stale. Up for more than two weeks. It may already be filled.
What the job is
NVIDIA is widely regarded as one of the technology industry’s most desirable employers. We lead the way in High-Performance Computing, Artificial Intelligence, and Visualization. Our core invention, the GPU, serves as the visual cortex of modern computers and powers our entire product suite.
NVIDIA is widely regarded as one of the technology industry’s most desirable employers. We lead the way in High-Performance Computing, Artificial Intelligence, and Visualization. Our core invention, the GPU, serves as the visual cortex of modern computers and powers our entire product suite. GPU deep learning ignited the modern AI era—the next great computing age—with the GPU acting as the brain for everything from robots and autonomous cars to conversational AI. Today, we are known globally as "the AI computing company." We are looking to grow our teams by bringing in the smartest people in the world. Join us at the forefront of technological advancement.
NVIDIA is hiring Senior Deep Learning Scientists to advance our efforts in streaming and agentic multimodal AI. You will demonstrate foundational expertise in deep learning, reinforcement learning, and applied mathematics to help develop models capable of reasoning, planning, and acting across diverse modalities. This is a chance to define core algorithmic improvements for multimodal foundation models, scaling your ideas through our Nemotron Omni and VoiceChat platforms. You will work on high-impact, high-visibility large language models and multimodal AI products that improve the experience for millions of users. If you are creative and passionate about solving real-world agentic AI challenges, come join our Nemotron LLM team. For more details on Nemotron LLM, check https://www.nvidia.com/en-us/ai-data-science/foundation-models/nemotron/
What you’ll be doing
- Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding.
- Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases.
- Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments.
- Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success.
What we need to see
- Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math with 5+ years of relevant work experience.
- Excellent programming skills in Python with strong fundamentals in scalable model development and deep learning frameworks like PyTorch.
- Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
- Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design.
- Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning, full-duplex voice chat, and human-AI interaction.
- Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.
NVIDIA is widely regarded as one of the technology industry’s most desirable employers. We lead the way in High-Performance Computing, Artificial Intelligence, and Visualization. Our core invention, the GPU, serves as the visual cortex of modern computers and powers our entire product suite. GPU deep learning ignited the modern AI era—the next great computing age—with the GPU acting as the brain for everything from robots and autonomous cars to conversational AI. Today, we are known globally as "the AI computing company." We are looking to grow our teams by bringing in the smartest people in the world. Join us at the forefront of technological advancement.
NVIDIA is hiring Senior Deep Learning Scientists to advance our efforts in streaming and agentic multimodal AI. You will demonstrate foundational expertise in deep learning, reinforcement learning, and applied mathematics to help develop models capable of reasoning, planning, and acting across diverse modalities. This is a chance to define core algorithmic improvements for multimodal foundation models, scaling your ideas through our Nemotron Omni and VoiceChat platforms. You will work on high-impact, high-visibility large language models and multimodal AI products that improve the experience for millions of users. If you are creative and passionate about solving real-world agentic AI challenges, come join our Nemotron LLM team. For more details on Nemotron LLM, check https://www.nvidia.com/en-us/ai-data-science/foundation-models/nemotron/
What you’ll be doing
- Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding.
- Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases.
- Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments.
- Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success.
What we need to see
- Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math with 5+ years of relevant work experience.
- Excellent programming skills in Python with strong fundamentals in scalable model development and deep learning frameworks like PyTorch.
- Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
- Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design.
- Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning, full-duplex voice chat, and human-AI interaction.
- Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.
Ways to stand out from the crowd
- Strong record of publications in top-tier AI and machine learning venues such as NeurIPS, ICML, ICLR, or CVPR.
- Validated experience training and deploying multimodal foundation models using large-scale distributed infrastructure.
- Experience applying deep reinforcement learning techniques to train multimodal agents in complex simulation or gaming environments.
- Background in audio/speech AI, especially audio language models or audio generation.
- Background in building embodied AI systems that integrate multimodal perception with backend action-fulfillment and long-horizon planning.
With highly competitive salaries and a comprehensive benefits package, NVIDIA is considered one of the industry’s most desirable employers. As you plan your future, see what we can offer you and your family at www.nvidiabenefits.com/. If you are a creative and autonomous engineer with a genuine passion for state-of-the-art technology, we want to hear from you!
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Similar open jobs
- Intern, Architecture Research Engineer (Agentic AI Workload Characterization)Samsung Semiconductor · San Jose, California, United States
- Staff Applied AI EngineerFloqast · Hybrid, San Jose, California
- Senior Machine Learning EngineerFloqast · Hybrid, San Jose, California
- Intern, Architecture Research Engineer (MoE Placement for Serving at Scale)Samsung Semiconductor · San Jose, California, United States
- Senior Machine Learning Scientist, Applied Causal InferenceDoorDash USA · San Francisco, CA · $137K to $202K a year
- Principal AI Platform Forward Deployment EngineerServiceNow · Santa Clara, California, United States · $221K to $387K a year
Machine learning engineer jobs in San Jose (445)Jobs in San Jose (7796)