Software Engineer, Applied AI

Shepherd

Where
San Francisco
Pay
$67 an hour

Posted 30 days ago· Checked live at Shepherd 37 minutes ago

Stale: open 30 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Shepherd asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Shepherd's own hiring page 37 minutes ago.
What is the job?
Build the insurance behind the physical world. The world is building data centers, energy projects, hospitals, schools, and critical infrastructure. Every one of those projects needs insurance to move forward. Yet the process of getting that insurance still depends on scattered documents, manual work, and weeks of back-and-forth.
What does it pay?
$67 an hour, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Build the insurance behind the physical world.

The world is building data centers, energy projects, hospitals, schools, and critical infrastructure. Every one of those projects needs insurance to move forward. Yet the process of getting that insurance still depends on scattered documents, manual work, and weeks of back-and-forth.

What you’ll do

  • Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities
  • Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling
  • Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data
  • Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring
  • Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions
  • Establish best practices for prompt engineering, evaluation frameworks, and model reliability
  • Own AI features end-to-end from ideation to production

What we’re looking for

  • Strong backend engineering experience building scalable APIs and distributed systems
  • Hands-on experience shipping AI-powered products into production
  • Familiarity with LLMs, RAG architectures, embeddings, and vector databases
  • Experience integrating AI systems into user-facing or workflow-driven applications
  • Comfort with cloud infrastructure and deploying AI workloads at scale
  • A product mindset and the ability to translate ambiguous business problems into concrete AI systems
  • You have at least 5+ years of working experience (preferably as a full-stack engineer) with a track record of delivering high-impact products

Bonus points

  • Experience building AI agents or multi-step reasoning systems
  • Background in applied machine learning beyond generative AI
  • Experience with pricing systems, financial infrastructure, or risk modeling
  • Interest in transforming legacy industries with modern AI systems

Benefits

🏥 Premium Healthcare

100% contribution to health, dental, and vision

🥕 Fertility benefits and family building support

🏖️ Flexible PTO

Flexibility to take the time off, recharge, and perform

🥗 Daily lunches, dinners, and snacks

We work together, and enjoy meals together too

🖥️ SF, NYC, Dallas-Fort Worth, Chicago and LA Offices

📚 Professional Development

Access to premium coaching, including leadership development

🏦 Competitive 401(k) Plan

🐶 Dog-friendly office

Plenty of dogs to play with and make friends with in the SF office

Similar open jobs

Machine learning engineer jobs in San Francisco (586)Jobs in San Francisco (11750)