Manager Data Science**Home based San Francisco, CA

RELX Inc. Company

Where
HB San Francisco, CA
Pay
$115K to $192K a year

Posted 59 days ago· Checked live at RELX Inc. Company 4 days ago

Stale: open 59 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what RELX Inc. Company asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on RELX Inc. Company's own hiring page 4 days ago.
What is the job?
LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.
What does it pay?
$115K to $192K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.

Responsibilit ies

  • Lead the design and execution of LLM training and fine-tuning projects, including model selection, training strategy, experimentation, and evaluation.
  • Oversee the preparation of high-quality training datasets, including data collection, cleaning, deduplication, annotation, and quality validation.
  • Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows; apply preference optimization methods where appropriate.
  • Establish evaluation frameworks to assess factual accuracy, instruction following, domain relevance, safety, and performance on business-specific tasks.
  • Diagnose training issues and improve model quality, training stability, GPU utilization, and computational efficiency.
  • Manage and mentor data scientists, review technical work, and establish reproducible development practices.
  • Partner with product, engineering, and domain experts to define requirements and support model deployment and monitoring.
  • Manage project priorities, timelines, and compute resources, and communicate results and tradeoffs to stakeholders.

Requirements

  • LLM fundamentals: Strong understanding of transformer architectures, attention mechanisms, tokenization, language modeling objectives, and the differences between pretraining, continued pretraining, and fine-tuning.
  • Programming and frameworks: Strong Python and PyTorch skills, with practical experience using Hugging Face Transformers, Datasets, or equivalent tools.
  • Hands-on LLM training: Demonstrated ability to implement supervised fine-tuning (SFT), configure training objectives and loss masking, tune hyperparameters, and select model checkpoints.
  • Efficient fine-tuning: Practical experience with parameter-efficient fine-tuning (PEFT), including LoRA or QLoRA, and an understanding of their quality, memory, and compute tradeoffs.
  • Training data engineering: Ability to build instruction-response datasets, apply chat templates, manage sequence lengths and packing, and prevent data leakage and evaluation contamination.
  • GPU and distributed training: Experience training models across multiple GPUs using frameworks such as PyTorch FSDP or DeepSpeed, including mixed precision, gradient accumulation, and gradient checkpointing.
  • Evaluation and debugging: Ability to design reliable benchmarks and human evaluations, analyze model errors, and troubleshoot unstable loss, overfitting, and GPU memory issues.
  • Reproducibility: Experience with experiment tracking, dataset and model versioning, checkpoint management, and documented training pipelines.

Work in a Way That Works for You

We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

Working Pattern

Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most product ive.

Similar open jobs

Data scientist jobs in San Francisco (196)Jobs in San Francisco (11741)