Researcher, Alignment

OpenAI

Where
San Francisco

Posted 27 months ago· Checked live at OpenAI 19 minutes ago

Stale: open 814 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 19 minutes ago.
What is the job?
The Alignment team at OpenAI is dedicated to ensuring that our AI systems are safe, trustworthy, and consistently aligned with human values, even as they scale in complexity and capability. Our work is at the cutting edge of AI research, focusing on developing methodologies that enable AI to robustly follow human intent across a wide range of scenarios, including those that are adversarial or high-stakes.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

The Alignment team at OpenAI is dedicated to ensuring that our AI systems are safe, trustworthy, and consistently aligned with human values, even as they scale in complexity and capability. Our work is at the cutting edge of AI research, focusing on developing methodologies that enable AI to robustly follow human intent across a wide range of scenarios, including those that are adversarial or high-stakes.

In this role, you will

We are seeking research engineers and research scientists to help design and implement experiments for alignment research. Responsibilities may include:

  • Develop and evaluate alignment capabilities that are subjective, context-dependent, and hard to measure.
  • Design evaluations to reliably measure risks and alignment with human intent and values.
  • Build tools and evaluations to study and test model robustness in different situations.
  • Design experiments to understand laws for how alignment scales as a function of compute, data, lengths of context and action, as well as resources of adversaries.
  • Design and evaluate new Human-AI-interaction paradigms and scalable oversight methods that redefine how humans interact with, understand, and supervise our models.
  • Train model to be calibrated on correctness and risk.
  • Designing novel approaches for using AI in alignment research

You might thrive in this role if you

  • Are a team player – willing to do a variety of tasks that move the team forward.
  • Have a PhD or equivalent experience in research in computer science, computational science, data science, cognitive science, or similar fields.
  • Have strong engineering skills, particularly in designing and optimizing large-scale machine learning systems(e.g., PyTorch).
  • Have a deep understanding of the science behind alignment algorithms and techniques.
  • Can develop data visualization or data collection interfaces (e.g., TypeScript, Python).
  • Enjoy fast-paced, collaborative, and cutting-edge research environments.
  • Want to focus on developing AI models that are trustworthy, safe, and reliable, especially in high-stakes scenarios.

Similar open jobs

Jobs in San Francisco (11750)