Staff Machine Learning Engineer - Foundation Model

XPENG

Where
Santa Clara, CA
Pay
$215K to $364K a year
Type
Full time

Posted 22 months ago· Checked live at XPENG 1 hour ago

Stale: open 673 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what XPENG asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on XPENG's own hiring page 1 hour ago.
What is the job?
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing ( eVTOL ) aircraft, and robotics.
What does it pay?
$215K to $364K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing ( eVTOL ) aircraft, and robotics.

Key Responsibilities

  • Design and implement large-scale multi-modal architectures (e.g., vision–language–action transformers) for end-to-end autonomous driving.
  • Develop pretraining and fine-tuning strategies leveraging massive labeled and unlabeled fleet data (images, video, LiDAR, CAN bus, maps, human driving behaviors, etc.).
  • Research and integrate cross-modal alignment (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.
  • Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks (FSDP, DDP, etc.).
  • Conduct systematic ablation, evaluation, and visualization of model behavior across perception, reasoning, and planning tasks.
  • Contribute to model deployment optimization, including quantization, export, and latency–accuracy trade-offs for onboard execution.

Minimum Qualifications

  • Master’s degree or higher in Computer Science, Electrical/Computer Engineering, or related field, with 3+ years of experience in deep learning research or productization.
  • Strong proficiency in PyTorch and modern transformer-based model design.
  • Experience in large-scale pretraining or multi-modal modeling (vision, language, or planning).
  • Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
  • Familiarity with distributed training (DDP, FSDP) and large-batch optimization.

Preferred Qualifications

  • PhD in CS/CE/EE or related field, with 1+ years of relevant industry experience.
  • Publication record in top-tier AI conferences (CVPR, ICCV, NeurIPS, ICLR, ICML, ECCV).
  • Prior experience building foundation or end-to-end driving models, or LLM /VLM architectures (e.g., ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies).
  • Familiarity with RLHF/DPO/GRPO, trajectory prediction, or policy learning for control tasks.
  • Proven ability to collaborate cross-functionally with infra, perception, and planning teams to deliver production-ready models.

Similar open jobs

Machine learning engineer jobs in San Jose (445)Jobs in San Jose (7796)