HPC Data Provenance – Postdoctoral Researcher

LLNL

Where
Hybrid in Livermore, CA, United States
Pay
$143K a year

Posted 1 day ago· Checked live at LLNL 2 hours ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what LLNL asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on LLNL's own hiring page 2 hours ago.
What is the job?
Job Description We are seeking a Postdoctoral Researcher to perform research in data provenance, multi-layer tracing, and I/O characterization for large-scale scientific and AI workflows on high-performance computing (HPC) systems. Scientists increasingly need to answer questions such as which data produced a result, what transformed it, and which downstream models and analyses are affected when that data changes.
What does it pay?
$143K a year, as the posting states.
Our verdict
Live. Open on the employer's own site.

What the job is

Job Description

We are seeking a Postdoctoral Researcher to perform research in data provenance, multi-layer tracing, and I/O characterization for large-scale scientific and AI workflows on high-performance computing (HPC) systems. Scientists increasingly need to answer questions such as which data produced a result, what transformed it, and which downstream models and analyses are affected when that data changes.

In this role you will

  • Research and develop low-overhead, multi-layer provenance and I/O capture techniques for HPC workflows spanning the application, runtime, I/O library, file system, and operating system layers.
  • Research and develop methods to integrate capture with HPC resource managers (e.g., Flux, Slurm) so that provenance is collected automatically without requiring changes to user workflows.
  • Design and implement scalable registries that assign stable identities to datasets, model checkpoints, and workflow stages and reconcile the names used for them across different tools.
  • Research and develop techniques to normalize, compress, and temporally align high-volume heterogeneous trace and event streams into a common schema.
  • Characterize and minimize the performance overhead of tracing and provenance capture on large-scale deep learning and scientific workloads.
  • Develop benchmarks, ground-truth datasets, and validation methodologies to evaluate provenance correctness, coverage, and overhead.
  • Develop high-quality, open-source software that is extensible and maintainable by downstream users and developers.
  • Deploy and evaluate software on Laboratory production HPC systems and interact with application scientists to understand practical, real-world requirements and limitations.
  • Pursue independent (but complementary) research interests and interact with team members internally and externally.
  • Publish research results in external peer-reviewed scientific journals and participate in conferences and workshops.
  • Present formal and informal overview of research progress at group meetings.
  • Participate in existing division collaborations and alliances with academia and industry.
  • Perform other duties as assigned.

Qualifications

  • PhD in Computer Science, Computer Engineering, or related field.
  • Research experience in HPC I/O, storage systems, or scientific data management.
  • Research experience in tracing, profiling, or performance analysis of parallel or distributed applications.
  • Research experience with large-scale deep learning or scientific workflows, either as workloads to characterize or as tools applied to systems problems.
  • Ability to conduct high-quality research and to develop implementations of sophisticated algorithms and systems to evaluate the results.
  • Experience programming in C/C++ and Python in a Linux environment.
  • Proficient verbal and written communication skills necessary to interact with members of a research team, author technical and scientific reports and papers, and deliver technical presentations.
  • Demonstrated publication record in peer-reviewed journals and/or conferences.
  • Strong decision-making skills necessary to independently solve complex research problems.

Qualifications We Desire (optional)

  • Experience with data provenance, lineage tracking, or reproducibility of scientific or machine learning workflows.
  • Experience with operating system internals or kernel-level instrumentation (e.g., the Linux kernel, eBPF).
  • Experience with I/O tracing and characterization tools (e.g., Darshan, DFTracer, Recorder) or I/O benchmarks for deep learning.
  • Experience indexing, compressing, or analyzing large trace or event datasets.
  • Experience running workloads on leadership-class HPC systems, parallel file systems, and HPC resource managers.
  • Experience developing and maintaining open-source research software with an external user community.

Pay Range

$143,328 Annually

Additional Information

All your information will be kept confidential according to EEO guidelines.

Position Information

This is a Postdoctoral appointment with the possibility of extension to a maximum of three years. The postdoctoral appointment is a temporary, mentored training position intended for individuals in the early stages of their postdoctoral research careers. Consistent with the structure of the program, applicants must have received their Ph.D. (or equivalent doctorate) within five years of the anticipated start date.