Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient Ai

Where
Hybrid in Redwood City
Type
Full time

Posted 2 months ago· Checked live at Ambient Ai 2 hours ago

Stale: open 70 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Ambient Ai asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Ambient Ai's own hiring page 2 hours ago.
What is the job?
Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Build a safer world with us, one incident at a time.

Ambient.ai is the category creator and leader in Agentic Physical Security.

What you'll do

  • Design, build, and maintain cutting-edge AI infrastructure for real-time computer vision, LLM, LVM, and multimodal inference workloads.
  • Build scalable systems for running state-of-the-art models across large volumes of video and sensor data.
  • Optimize inference performance across latency, throughput, GPU utilization, reliability, and cost.
  • Develop robust evaluation harnesses and benchmarking systems to measure model quality, system performance, regressions, and production readiness.
  • Build infrastructure for continuous model evaluation, experimentation, and deployment.
  • Partner with research scientists to productionize the latest advances in computer vision, LLMs, LVMs, RAG, and multimodal AI.
  • Improve model-serving architecture, including batching, caching, routing, quantization, model parallelism, and hardware utilization.
  • Develop data engines and feedback loops for collecting training data, evaluating model behavior, and continuously improving AI performance.
  • Create reliable observability, monitoring, and debugging tools for production AI systems.
  • Help define best practices for deploying, evaluating, and operating AI systems in real-world enterprise environments.

Nice to have

  • Experience operating large-scale GPU infrastructure or distributed inference systems.
  • Experience with CUDA, NCCL, PyTorch, TensorRT, ONNX, or similar ML systems technologies.
  • Experience with video understanding, real-time computer vision, multimodal AI, or physical-world AI systems.
  • Experience with model compression, speculative decoding, distillation, pruning, or low-latency serving techniques.
  • Experience with prompt evaluation, model regression testing, human-in-the-loop evaluation, or automated quality gates.
  • Familiarity with retrieval-augmented generation, vector databases, embedding models, re-rankers, or search infrastructure.
  • Experience building internal ML platforms or tools used by researchers and applied ML teams.

Why join us

  • We are creating an entirely new category within a 180+ billion-dollar physical security industry and looking for team members who are also passionate about our mission to prevent every security incident possible
  • We partner with an incredible customer roster of F500 companies, including Adobe, TikTok, Gap and SentinelOne
  • Regular Full-time employees receive stock options for the opportunity to share ownership in the success of our company
  • Comprehensive health + welfare package (Medical, Dental, Vision, Life, EAP, Legal Services, 401k plan)
  • We offer flexible time off to rest and recharge, including Winter Break (time off between Christmas and New Year’s for most roles, depending on customer demand)
  • The latest tech and awesome swag will be delivered to your door
  • Enjoy a full range of opportunities to connect with your awesome co-workers
  • We love to hike https://www.alltrails.com/us/california/redwood-city, are foodies, and love music! Check out our most recent Ambient Spotify Playlist https://open.spotify.com/playlist/2kx8dM5h65Tac5UOo0kuWr?si=cebFZmkHQhKEvnoall2rcQ

We’ve found that in-person time meaningfully supports collaboration, creativity, and team alignment. Our talent, engineering, product, design, and marketing teams work from our Redwood City office three days a week. All other Bay Area employees join on Fridays to stay connected and close out the week together.

Ready to learn more? Connect with us onLinkedIn https://www.linkedin.com/company/ambient-ai/?viewAsMember=true| YouTube https://www.youtube.com/@ambient2599

Ambient.ai is proud to be an Equal Opportunity Employer. Ambient does not unlawfully discriminate on the basis of race, color, religion, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), gender identity, gender expression, national origin, ancestry citizenship, age, physical or mental disability, legally protected medical condition, family care status, military or veteran status, marital status, registered domestic partner status, sexual orientation, genetic information, or any other basis protected by local, state, or federal laws. Ambient is an E-Verify participant.