Applied ML Engineer - Edge Devices

Deepgram

Where
USA - Remote

Posted 2 months ago· Checked live at Deepgram 2 hours ago

Stale: open 65 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Deepgram asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Deepgram's own hiring page 2 hours ago.
What is the job?
Deepgram is bringing the world’s most natural interface, voice, to the technology we use every day. Our speech models and real-time infrastructure power AI systems that keep up with the way people actually speak. More than 5,000 organizations run conversational voice AI on Deepgram in production, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Cresta, Granola, and Jack in the Box.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Deepgram is bringing the world’s most natural interface, voice, to the technology we use every day. Our speech models and real-time infrastructure power AI systems that keep up with the way people actually speak. More than 5,000 organizations run conversational voice AI on Deepgram in production, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Cresta, Granola, and Jack in the Box.

What you'll do

  • Port Deepgram speech models to non-NVIDIA and edge platforms, adapting model structure and parameters so they run within the target's existing operator set, runtime, and kernels with minimal modification.
  • Own serving-side model decisions for edge targets: quantization and precision choices, operator substitution, graph rewrites, and architecture tweaks that fit a model to a device's constraints while holding accuracy and latency.
  • Validate every port on real hardware: build accuracy, latency, throughput, and memory benchmarks per platform, and catch regressions before a customer does.
  • Build the deployment path for edge targets: model packaging, conversion pipelines, versioning, and automated delivery so shipping a model to a new device is repeatable rather than bespoke.
  • Work with Embedded AI Engineers when a standard kernel isn't enough: specify what the model needs, then adapt the model to use the custom kernel they deliver.
  • Partner with platform and silicon vendors on their runtimes and toolchains, and turn their expected model format and operator conventions into a working Deepgram deployment.
  • Feed edge constraints back to Research and Impeller so future models are easier to port, without taking on research or core productionization work yourself.
  • As the team grows, take on adjacent production concerns at the edge: automated deployment, model security and integrity on customer hardware, and fleet-level observability.

It's important to us that you have

  • Hands-on experience deploying ML models to edge or non-NVIDIA hardware in production. This is required. Cloud-only or GPU-only serving experience does not qualify on its own.
  • Working knowledge of quantization and precision tradeoffs (INT8, FP16, mixed precision, calibration) and how they affect accuracy and latency on real targets.
  • Experience with at least one edge or vendor inference runtime and its conversion toolchain (for example ONNX Runtime, TFLite, ExecuTorch, OpenVINO, Qualcomm AI Engine, or a vendor NPU SDK).
  • Ability to modify a model to fit a platform: reading and rewriting model graphs, swapping unsupported operators, and adjusting architecture parameters without breaking accuracy.
  • Strong Python and PyTorch, and production-quality engineering habits: tests, reproducibility, and benchmarks that others can rerun.
  • Comfort building automation around model conversion and deployment.
  • A builder mindset and clear communication: you can scope a port on an unfamiliar platform and drive it to a measured result.

Similar open jobs

Remote machine learning engineer jobs (519)