Data Scientist, Preparedness

OpenAI

Where
San Francisco

Posted 13 days ago· Checked live at OpenAI 59 minutes ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 59 minutes ago.
What is the job?
The Preparedness team is an important part of the Safety Systems https://openai.com/safety/safety-systems org at OpenAI, and is guided by OpenAI’s Preparedness Framework https://openai.com/index/updating-our-preparedness-framework/. Frontier AI models have the potential to benefit all of humanity, but also pose increasingly severe risks.
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

The Preparedness team is an important part of the Safety Systems https://openai.com/safety/safety-systems org at OpenAI, and is guided by OpenAI’s Preparedness Framework https://openai.com/index/updating-our-preparedness-framework/.

Frontier AI models have the potential to benefit all of humanity, but also pose increasingly severe risks.

What you’ll do

  • Evaluate and improve mitigation systems, including classifiers and detection pipelines across domains (e.g., biosecurity, cybersecurity, and emerging risk areas).
  • Diagnose false positives and false negatives with deep error analysis, root cause investigation, and clear recommendations for mitigation adjustments.
  • Build monitoring and measurement frameworks to track mitigation effectiveness over time and across user segments and use cases.
  • Identify trends in over-blocking vs. under-blocking, quantify customer impact, and propose prioritized interventions.
  • Develop insights from customer feedback, complaints, and usage patterns to detect shifts in adversarial behavior and system failure modes.
  • Expand risk monitoring into new areas, including cybersecurity threats and model loss-of-control or sabotage scenarios, in partnership with domain experts.
  • Communicate results to technical and executive stakeholders with crisp narratives, decision-ready metrics, and clear tradeoffs.

You might thrive in this role if you are

  • An autonomous operator: you can take a problem statement and independently structure the analysis end-to-end.
  • Strong at executive-ready communication: concise, clear, and outcome-oriented.
  • Skilled in turning analysis into productable changes: you’re comfortable influencing across functions to drive mitigation improvements.

Qualifications

  • Significant experience in data science or applied analytics in high-stakes domains (e.g., security, trust & safety, abuse prevention, fraud, platform integrity, or reliability).
  • Strong foundations in experimentation, causal thinking, and/or observational inference; ability to design robust measurement under imperfect data.
  • Fluency in SQL and Python (or equivalent) for analysis, modeling, and building monitoring workflows.
  • Experience building metrics, dashboards, and operational monitoring that meaningfully changes outcomes (not just reporting).
  • Track record of driving cross-functional impact with engineering, product, and research partners.
  • Cybersecurity data science experience (strong preference), including exposure to threat modeling, adversarial dynamics, abuse patterns, or security telemetry.
  • Experience with classifier evaluation, calibration, thresholding, and error analysis at scale.

Familiarity with detection systems in adversarial settings (e.g., evasion, distribution shift, feedback loops).

  • Trust & Safety experience is helpful, but not required.
  • Genuine interest in AI safety, alignment, and catastrophic risk prevention.

Similar open jobs

Data scientist jobs in San Francisco (198)Jobs in San Francisco (11750)