Senior Machine Learning Engineer, Accelerated Apache Spark

NVIDIA

Where
US, CA, Santa Clara

Posted 20 days ago· Checked live at NVIDIA 3 days ago

Stale: open 20 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what NVIDIA asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on NVIDIA's own hiring page 3 days ago.
What is the job?
NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team. Apache Spark is the most popular data processing engine in data centers for running massive scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning many domains and use cases.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.

Apache Spark is the most popular data processing engine in data centers for running massive scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning many domains and use cases.

NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.

Apache Spark is the most popular data processing engine in data centers for running massive scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning many domains and use cases. NVIDIA GPUs offer a promising avenue for significantly speeding up and/or lowering the cost of running very large Apache Spark applications. You will work with the open source community to accelerate Apache Spark with GPUs. You will apply the latest ML/AI methods to empower enterprises to migrate Spark workloads onto GPUs at scale.

What you’ll be doing

  • Design and implement machine learning solutions for performance prediction and optimization of GPU accelerated enterprise Apache Spark workloads.
  • Develop advanced algorithms and adaptive systems to continuously improve the performance of Apache Spark workloads on GPUs.
  • Develop AI-based agents and tools to assist with fixing system issues and application optimization.
  • Collaborate with key partners and customers on the deployment of complex machine learning solutions in various environments.
  • Maintain deep domain expertise by knowing the latest published advances in ML systems and algorithms.
  • Provide technical mentorship and leadership in data science and machine learning to a team of engineers.

What we need to see

  • BS, MS, or PhD or equivalent experience in Machine Learning, Data Science, Computer Science or a closely related field.
  • 12+ years of professional experience in designing, implementing, and productionizing high-quality ML/DL solutions.
  • 3+ experience as technical lead in ML model development.
  • Proven hands-on experience (2+ years) with large-scale data processing platforms, such as Apache Spark.
  • Proven ability to employ modern tooling and sound techniques for all aspects of crafting, deploying, and maintaining machine learning models.
  • Excellent programming skills in Python and Python data science related libraries like numpy, pandas, scikit-learn, scipy, pytorch, and tensorflow.
  • Deep experience with sophisticated ML methodologies, including LLM/GenAI, reinforcement learning, and adaptive, on-line ML systems.
  • Strong expertise in feature engineering, feature importance assessment, and developing boosted tree model solutions (e.g., XGBoost).

Similar open jobs

Machine learning engineer jobs in San Jose (445)Jobs in San Jose (7796)