Model Policy Manager, Agentic Safety

OpenAI

Where
Hybrid in San Francisco

Posted 2 months ago· Checked live at OpenAI 19 minutes ago

Stale: open 65 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 19 minutes ago.
What is the job?
Our Safety Systems https://openai.com/safety/safety-systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Our Safety Systems https://openai.com/safety/safety-systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments.

Your Responsibilities

  • Identify vulnerabilities that emerge as models interact with tools, data, and external systems, and translate them into model- and system-level safeguards.
  • Develop threat models and empirical frameworks for understanding harmful outcomes from misaligned behavior.
  • Build frameworks for understanding harmful outcomes arising from model misalignment.
  • Identify the underlying behaviors and system conditions that drive those outcomes.
  • Turn findings into policy frameworks, evaluation criteria, online measurement and safeguards.
  • Develop human data campaigns and gold sets to ground measurement and evaluation of emerging behaviors and risks.
  • Partner with research, engineering, security, and product teams to shape model and system safety, balancing difficult trade-offs between safety, utility, and business risk.
  • Inform deployment decisions, system cards, safeguards reports, and OpenAI’s broader approach to agentic safety.
  • Build monitoring approaches that detect regressions and emerging risks after deployment.

Similar open jobs

Jobs in San Francisco (11750)