AI Engineer

Crogl

Where
Remote (United States)

Posted 4 months ago· Checked live at Crogl 1 hour ago

Stale: open 141 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Crogl asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Crogl's own hiring page 1 hour ago.
What is the job?
Crogl Fully Autonomous AI Team Member for Your SOC
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Crogl

Fully Autonomous AI Team Member for Your SOC

Crogl is building AI-powered systems that help security teams investigate, understand, and respond to threats faster. We combine advances in large language models, agent architectures, and security expertise to create intelligent systems that solve real-world problems for security practitioners.

Crogl

Fully Autonomous AI Team Member for Your SOC

Crogl is building AI-powered systems that help security teams investigate, understand, and respond to threats faster. We combine advances in large language models, agent architectures, and security expertise to create intelligent systems that solve real-world problems for security practitioners.

We’re looking for AI Engineers who are excited about building practical AI products. You’ll help design, evaluate, and improve agentic systems that operate in production, working closely with customers, engineers, and product teams to push the boundaries of what’s possible with modern AI.

What you’ll be doing

  • Build LLM-powered features, workflows, and agentic systems that solve real customer problems.
  • Design and implement evaluation frameworks to measure agent quality, reliability, and business impact.
  • Create automated benchmarks, regression tests, and datasets for evaluating AI behavior.
  • Investigate agent failures and develop systematic approaches to improve performance.
  • Experiment with prompting, tool use, retrieval, memory, planning, and reasoning strategies.
  • Build infrastructure that supports rapid experimentation, evaluation, deployment, and monitoring.
  • Work closely with customers and internal teams to understand workflows and identify opportunities for AI automation.
  • Contribute to engineering best practices for testing, observability, and production reliability.
  • Stay current with advances in LLMs, agents, evaluation methodologies, and AI engineering.

A core part of this role: evaluating AI systems

Building agents is only half the challenge. Understanding whether they are actually improving is equally important. A significant portion of this role involves designing and maintaining evaluation systems for AI agents operating in real-world security workflows.

You’ll help answer questions like

  • Is the agent producing accurate investigations?
  • Are changes to prompts, tools, or models actually improving outcomes?
  • How do we detect regressions before customers experience them?
  • Which failure modes matter most?
  • How do we measure reliability, trustworthiness, and business impact?

You’ll build benchmarks, datasets, automated evaluations, regression testing pipelines, and observability systems that help us continuously improve agent performance.

Similar open jobs

Remote machine learning engineer jobs (519)