Senior Backend Engineer (AI Platform)

Careers Azx Io

Where
Remote (United States)
Type
Full time

Posted 2 months ago· Checked live at Careers Azx Io 2 hours ago

Stale: open 80 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Careers Azx Io asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Careers Azx Io's own hiring page 2 hours ago.
What is the job?
Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability challenges. We’re growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen Energy), logistics (Flexe) and utilities.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability challenges.

We’re growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen Energy), logistics (Flexe) and utilities.

Responsibilities

  • Own the LLM gateway: routing, metering, budgets, guardrail composition, and provider/backend adapters across hosted and self-hosted models.
  • Manage the retrieval and knowledge service: connectors, chunking, hybrid search and reranking, grounded answers, and the MCP surface.
  • Build the eval harness that turns retrieval tuning from judgment into evidence, with confidence intervals and per-segment breakdowns.
  • Own the async framework — its public API, rate-limit algorithms, and admin tooling — and lead its evolution into durable execution for agent runs.
  • Design authorization across the whole surface: token hierarchies, capability grammars, and per-tenant isolation tested as a regression, not asserted in a doc.
  • Own your own definition of done on everything you ship: evals, traces, cost accounting, and the dashboard that would wake you up.

Core Qualifications

  • 5+ years of deep, production async Python — cancellation scopes, streaming lifecycle, and connection pooling
  • Postgres as infrastructure — comfortable reasoning about MVCC, advisory locks, and vacuum discipline, with Redis/Dragonfly used (and not used) where it belongs; real distributed-systems experience, not just familiarity.
  • Experience shipping API surfaces other engineers build on — versioning, idempotency, error vocabularies, migration discipline, and documentation to match.
  • Depth in at least one of LLM gateway concern (routing, metering, guardrails, provider failover) or retrieval engineering (hybrid search, reranking, eval methodology, audit-ready RAG), with credibility on the other.
  • A cost accounting and evals first mindset — you've shipped a gate or harness that caught a real regression, ideally one of your own.
  • Production depth in some modern stack, and the aptitude to ramp quickly on unfamiliar tools
  • Practical familiarity with our core stack — Python 3.12+ (async, type-strict, FastAPI/Starlette, Pydantic v2), asyncpg/SQLAlchemy, Postgres (incl. pgvector), and Redis/Dragonfly with Lua — with willingness to research into the rest.
  • Exposure to the surrounding ecosystem: OpenTelemetry (incl. GenAI conventions), SSE/streaming lifecycles, OpenAI/Anthropic provider APIs, job frameworks (Celery/Dramatiq/Prefect-class), rate-limit algorithms (token bucket, GCRA), and integer-cents money handling.
  • Past work in energy, real estate, utilities, climate or related fields is a plus
  • Experience in both startup and enterprise environments is a plus

Why AZX!

  • Be part of a fast-growing, profitable, mission-driven company with industry-leading clients tackling the massive opportunity of AI transformation in critical industries.
  • Competitive early-stage startup compensation (based on capabilities, experience, and location)
  • Bonus eligibility
  • Health insurance with meaningful coverage for dependents
  • Flexible paid time off
  • Equity
  • Fully remote culture with a cluster of teammates in Seattle

Similar open jobs

Remote software engineer jobs (2055)