Technical Certification Lead

OpenAI

Where
Hybrid in San Francisco

Posted 1 hour ago· Checked live at OpenAI 40 minutes ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what OpenAI asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on OpenAI's own hiring page 40 minutes ago.
What is the job?
Customer Education helps customers build the practical skills and confidence to use AI and OpenAI products safely and effectively. We bring together customer insight, learning and enablement expertise, product signals, and measurement to help organizations move from access to durable adoption.
What does it pay?
The posting doesn't say.
Our verdict
Live. Open on the employer's own site.

What the job is

Customer Education helps customers build the practical skills and confidence to use AI and OpenAI products safely and effectively. We bring together customer insight, learning and enablement expertise, product signals, and measurement to help organizations move from access to durable adoption.

In this role, you will

  • Build and maintain competency models and facilitate job-task analyses for technical roles. Work with practitioners and subject matter experts (SMEs) to identify critical tasks, define the skills and proficiency each role requires, and keep the models current.
  • Define and maintain assessment blueprints and write scoring rubrics. Translate competencies into realistic tasks, define what evidence candidates must produce, and set clear criteria for evaluating performance in line with shared certification standards.
  • Lead standard-setting with subject matter experts and a psychometrician or measurement specialist, using a shared methodology to recommend the passing standard for each assessment.
  • Validate AI-assisted scoring against judgments from calibrated human reviewers. Define when scores require human review, and revalidate scoring after material changes to the model, assessment task, or rubric.
  • Manage and develop Certification Assessment Specialists across technical certifications. Set priorities, review their work, and guide the build and maintenance of assessment tasks, environments, evidence capture, and scoring workflows.
  • Secure and manage SME commitments for role analysis, task design, technical review, pilot feedback, and maintenance. Define what each expert is contributing and when it is needed.
  • Share competency models and permitted blueprint information with learning content developers, and review their content for alignment. Coordinate assessment and curriculum changes through the technical lead rather than direct sharing of confidential assessment details between assessment and learning teams.
  • Own ongoing assessment quality for each technical certification within shared program standards. Use pilot results, scoring consistency, technical reviews, and candidate feedback to identify issues. Partner with certification and measurement teams to calibrate rubrics and decide what needs updating or revalidation.
  • Provide technical input when candidates challenge an assessment task. Partner with operations to oversee fixes and validation for confirmed defects.
  • Define what credential holders must demonstrate to stay certified, when they must demonstrate it, and what evidence counts. Work with the team to align those requirements with shared standards, and with learning, platform, and operations teams to make appropriate renewal options available.
  • Make evidence-based readiness recommendations for pilots, launches, and updates. Document what has been tested, what risks remain, and which issues must be resolved before release. Coordinate technical handoff and delivery readiness with operations and platform teams.

You might thrive in this role if you

  • Have led the development and maintenance of role-based technical certifications or other high-stakes technical assessments, from role analysis through pilot, launch, and post-launch improvement.
  • Have directly managed and developed engineers or technical assessment specialists, including setting priorities, providing performance feedback, and improving the quality of the team’s work.
  • Have experience working at a technology company in a fast-paced environment, setting priorities and delivering work amid changing requirements and evolving business needs.
  • Have personally built competency models, facilitated job-task analyses, and used them to define assessment blueprints and write scoring rubrics.
  • Have designed hands-on assessments for software engineering, AI, cloud, or technical implementation roles, and can distinguish authentic evidence of capability from completion of a task.
  • Have built or validated AI-assisted scoring for assessments, with appropriate human review.
  • Have recruited and coordinated subject matter experts across teams, secured their time, and turned differing expert views into clear assessment decisions.
  • Have used evidence from pilots and live assessments to improve tasks and scoring, and can explain what would make you recommend a launch, a narrower pilot, or a delay.
  • Have worked with learning content developers to map curriculum and practice to competencies while maintaining the separation between preparation and assessment content.
  • Communicate technical and measurement tradeoffs clearly to engineers, learning teams, operations partners, and leaders.
  • Can review technical assessment work directly and coach others through design decisions without becoming the bottleneck.
  • Have maintained multiple technical assessments as products, tools, or job expectations changed, and know when to update or retire a task.
  • Care deeply about accessible assessments, consistent scoring, and making only the claims the evidence supports.

It’s a plus if you have experience

  • Designing practical assessments for AI application development, agentic workflows, or customer-facing AI deployments.
  • Working with psychometricians on standard setting, rubric calibration, or validation of performance assessments.
  • Launching hands-on assessments across live and virtual delivery environments.

Similar open jobs

Jobs in San Francisco (11741)