AI Agent Engineer

Scout Motors

Where
Charlotte, North Carolina, United States
Pay
$95K a year
Type
Full time

Posted 5 months ago· Checked live at Scout Motors 1 hour ago

Stale: open 161 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Scout Motors asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Scout Motors's own hiring page 1 hour ago.
What is the job?
Here at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history. A vehicle dating back to 1960. One that forged the path for future generations of rugged SUVs and trucks and will do so once again. But Scout is more than just a brand, it’s a legacy steeped in a culture of exploration, caretaking, and hard work.
What does it pay?
$95K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Here at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history. A vehicle dating back to 1960. One that forged the path for future generations of rugged SUVs and trucks and will do so once again.

But Scout is more than just a brand, it’s a legacy steeped in a culture of exploration, caretaking, and hard work.

What you’ll do

Become part of an iconic brand that is set to revolutionize the electric pick-up truck & rugged SUV marketplace by achieving the following:

  • Design, develop and deploy AI agents on Databricks, owning the full lifecycle from prototyping to production – including versioning, monitoring, and maintenance of multiple agents running in parallel
  • Build and maintain robust evaluation frameworks  using MLflow's evaluation suite, implementing and customizing judges (built-in, guideline-based, and custom) to systematically assess agent quality across correctness, safety, and business-specific criteria
  • Drive continuous quality improvement  of AI agents through structured offline evaluation pipelines (curated datasets, benchmarks) and online production monitoring, leveraging MLflow tracing to understand agent execution patterns
  • Collect, structure and incorporate human feedback  from diverse stakeholder groups (engineering, quality, business) into evaluation workflows and agent improvement cycles
  • Collaborate with Data Engineers, IT, and R&D  to define data configurations and pipelines that feed AI agents with reliable, high-quality inputs
  • Leverage and combine multiple data sources  (on-site, off-site, connected vehicle data) to build agents that identify trends, anomalies, and quality signals at scale
  • Surface agent outputs and quality insights  to Quality business stakeholders through dashboards and visual reporting tools, translating complex model behavior into understandable and actionable information
  • Identify and close data quality gaps, ensuring that data feeding into agents is clean, consistent, and continuously improving through well-defined requirements and automated checks

Technical Skills

  • Hands-on experience developing and deploying AI agents  on Databricks (Mosaic AI / Databricks Agent Framework), including multi-agent architectures and agent lifecycle management
  • Deep expertise in MLflow: Tracking, Model Registry, Deployments, Evaluation framework (built-in, guideline & custom judges) and Tracing for agent observability
  • Strong proficiency in Python  and agent development frameworks (e.g. LangChain, LlamaIndex, AutoGen, or similar)
  • Proficiency in  SQL  and cloud-based storage systems (Delta Lake, Unity Catalog, or equivalent)
  • Familiarity with  CI/CD practices  for ML systems (model versioning, automated testing pipelines, deployment gates)
  • Experience with  BI tools  (e.g. Sigma, PowerBI)  (nice to have)
  • Experience building  RAG pipelines  including Vector Store integration (e.g. Databricks Vector Search), embedding models and chunking strategies  (nice to have)
  • Familiarity with  Streamlit or Gradio  for lightweight internal tooling  (nice to have)
  • Knowledge of  responsible AI / AI governance  frameworks  (nice to have)

Soft Skills & Ways of Working

  • Strong  communication skills  – able to translate technical evaluation results into clear, business-relevant insights for quality and engineering stakeholders
  • Structured problem-solving mindset  with the ability to define methodologies, prioritize independently, and drive assignments to completion with minimal supervision
  • Comfortable operating in  multidisciplinary, fast-moving environments  with ambiguous requirements
  • Growth mindset  – eager to stay current with the rapidly evolving AI agent and LLMOps landscape

What you'll gain

The benefits of joining Scout include the chance to build products and a company from the ground up. This is a chance to create something new and lasting – with an iconic brand at its foundation. In addition, Scout provides competitive compensation and benefits to support your physical, mental, and financial wellbeing. Program specifics are detailed in company policies and employee benefit guides, select highlights:

  • Competitive insurance including:
  • Medical, dental, vision and income protection plans
  • 401(k) program with:
  • An employer match and immediate vesting
  • Generous Paid Time Off including:
  • 20 days planned PTO, as accrued
  • 40 hours of unplanned PTO and 14 company or floating holidays, annually
  • Up to 16 weeks of paid parental leave for biological and adoptive parents of all genders
  • Paid leave for circumstances related to bereavement, jury duty, voting time, or military leave

Pay Transparency

This is a full-time, exempt position eligible to receive a base salary and to participate in an annual performance bonus program. Final salary offered will be determined based on factors including but not limited to the candidate's skills and experience. The annual performance bonus program is preset and not candidate dependent.

Initial Base Salary Range: $95,000.00 - $140,000.00

Internal Leveling Code: IC9