Head of AI Engineering

Baker Tilly Advisory Group, LP

Where
USA CA San Jose 300 Santana Row
Pay
$250K to $400K a year

Posted 17 days ago· Checked live at Baker Tilly Advisory Group, LP 4 days ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Baker Tilly Advisory Group, LP asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Baker Tilly Advisory Group, LP's own hiring page 4 days ago.
What is the job?
Baker Tilly is a leading advisory, tax and assurance firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world’s leading financial centers – New York, London, San Francisco, Los Angeles, Chicago and Boston.
What does it pay?
$250K to $400K a year, as the posting states.
Our verdict
Live. Open on the employer's own site.

What the job is

Baker Tilly is a leading advisory, tax and assurance firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world’s leading financial centers – New York, London, San Francisco, Los Angeles, Chicago and Boston.

Responsibilities

  • Define and build agentic reference patterns, including task decomposition, orchestration, context engineering, memory management, tool use, human-in-the-loop checkpoints, and failure containment and recovery.
  • Maintain the agent pattern library and establish orchestration standards that product teams can consistently build from.
  • Own the Compass agents and full-stack product experiences end to end, on the intelligence layer built by the Data & AI Platform team.
  • Build and own the evaluation harness, baselines, and regression discipline used to drive iteration and inform release and acceptance decisions for internally developed and third-party agents.
  • Establish evaluation and acceptance criteria in partnership with Product, Architecture, Platform & Production Engineering, Quality Engineering, and other key stakeholders.
  • Partner with Platform & Production Engineering to enable evaluation capabilities to operate at scale in production.
  • Lead the Agent Factory as it grows, setting a high standard for agent design, engineering quality, and full-stack product development.
  • Conduct hands-on design and code reviews across product teams and mentor engineers in agentic engineering practices.
  • Hire and develop full-stack, forward-deployed AI engineers who can build both agents and the applications in which they operate.
  • Partner with expert agentic-engineering resources to absorb leading practices and translate them into Baker Tilly-owned standards, patterns, and runbooks.
  • Direct third-party and partner engineers delivering solutions against Baker Tilly’s technical standards.
  • Evaluate third-party and vendor agents against the firm’s established technical and evaluation standards.
  • Partner with the Chief Architect to establish evaluation standards and promote proven patterns into the platform’s shared library.
  • Collaborate closely with Data & AI Platform, Product, Design, Quality Engineering, Platform & Production Engineering, subject matter experts, and engineering teams in India.
  • Engage in special projects and perform other duties as assigned.

Qualifications

  • Bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience; advanced degree preferred.
  • 15+ years of software engineering experience, including 3+ years building and deploying LLM-based or agentic systems in production.
  • Staff- or principal-level engineering experience with demonstrated success personally designing and shipping production agent systems.
  • Deep experience designing and building evaluation harnesses and using evaluation results, baselines, and regression testing to drive iteration and release decisions.
  • Strong knowledge of the modern agentic technology stack, including orchestration frameworks, tool/function calling and MCP, retrieval using vector and graph approaches, and context and memory management.
  • Experience with evaluation methodologies, including evaluation design, baselines, regression discipline, confidence frameworks, and LLM-as-judge patterns and limitations.
  • Full-stack product engineering experience, including building the applications and user experiences in which agents operate.
  • Experience designing human-in-the-loop workflows, checkpoints, review experiences, and failure-containment mechanisms.
  • Strong hands-on software engineering skills with recent experience writing production-quality code in Python and/or TypeScript.
  • Experience with observability and tracing for agentic systems.
  • Experience directing third-party or partner engineers against established technical standards.
  • Experience evaluating third-party technologies or vendor agents against internal technical and quality standards.
  • Demonstrated ability to use AI and agentic development tools as a force multiplier in day-to-day engineering work.
  • Strong ability to collaborate across engineering, product, design, platform, and business teams while translating emerging technical practices into repeatable standards.
  • No certifications or licenses required.

The pay range for this position is $250,000 to $400,000. This range represents a good-faith and reasonable estimate of the compensation the firm expects to pay for this position at the time of posting. Actual compensation will depend on a variety of relevant factors, including an applicant’s skills, experience, qualifications, professional certifications, work arrangements, geographic location, and other business and organizational needs. It is not typical for an individual to be hired at or near the top of the range, and compensation decisions depend on the facts and circumstances of each case. Baker Tilly offers a compensation and benefits package to eligible employees.

Similar open jobs

Machine learning engineer jobs in San Francisco (584)Machine learning engineer jobs in Seattle (184)Machine learning engineer jobs in Los Angeles (56)Machine learning engineer jobs in San Jose (445)Jobs in San Francisco (11741)Jobs in Seattle (5774)Jobs in Los Angeles (5195)Jobs in San Jose (7798)