Researcher, Frontier Cybersecurity Risks

OpenAI

Where
San Francisco

Posted 3 months ago· Checked live at OpenAI 1 minute ago

Stale: open 107 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 1 minute ago.
What is the job?
Models are becoming increasingly capable—moving from tools that assist humans to agents that can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI’s ability to continue deploying models safely. The Preparedness team is dedicated to addressing these critical risks. Our work includes:
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Models are becoming increasingly capable—moving from tools that assist humans to agents that can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI’s ability to continue deploying models safely.

The Preparedness team is dedicated to addressing these critical risks. Our work includes:

In this role, you will

  • Design and implement mitigation components for model-enabled cybersecurity misuse—spanning prevention, monitoring, detection, and enforcement—under the guidance of senior technical and risk leadership.
  • Integrate safeguards across product surfaces in partnership with product and engineering teams, helping ensure protections are consistent, low-latency, and scale with usage and new model capabilities.
  • Evaluate technical trade-offs within the cybersecurity risk domain (coverage, latency, model utility, and user privacy) and propose pragmatic, testable solutions.
  • Collaborate closely with risk and threat modeling partners to align mitigation design with anticipated attacker behaviors and high-impact misuse scenarios.
  • Execute rigorous testing and red-teaming workflows, helping stress-test the mitigation stack against evolving threats (e.g., novel exploits, tool-use chains, automated attack workflows) and across different product surfaces—then iterate based on findings.

You might thrive in this role if you

  • Have a passion for AI safety and are motivated to make cutting-edge AI models safer for real-world use.
  • Bring demonstrated experience in deep learning and transformer models.
  • Are proficient with frameworks such as PyTorch or TensorFlow.
  • Possess a strong foundation in data structures, algorithms, and software engineering principles.
  • Are familiar with methods for training and fine-tuning large language models, including distillation, supervised fine-tuning, and policy optimization.
  • Excel at working collaboratively with cross-functional teams across research, security, policy, product, and engineering.
  • Have significant experience designing and deploying technical safeguards for abuse prevention, detection, and enforcement at scale.
  • (Nice to have) Bring background knowledge in cybersecurity or adjacent fields.

Similar open jobs

Jobs in San Francisco (11750)