Conversational Modelling Research Engineer

Tavus

Where
Remote

Posted 7 months ago· Checked live at Tavus 1 hour ago

Stale: open 211 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Tavus asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Tavus's own hiring page 1 hour ago.
What is the job?
Tavus https://www.tavus.io/ is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Tavus https://www.tavus.io/ is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations.

Your mission 🚀

  • Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g. Neural Avatars, Talking-Heads).
  • Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency.
  • Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models, more expressive, controllable, and task-specific.
  • Partner with the Applied ML team to take research from prototype to production.
  • Stay up to date with cutting-edge advancements — and help define what comes next.

You’ll be great at this if you have

  • A PhD (or near completion) in a relevant field, or equivalent research experience.
  • Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models. This could be in the context of tasks such as VQA, Audio/Video understanding tasks, captioning behavioral analysis, Translation tasks, Speech to Speech systems.
  • Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.
  • Solid background in deep learning and foundation modes.
  • Strong PyTorch skills and comfort building deep learning pipelines.

Nice-to-haves

  • Knowledge of large-scale model training and optimization.
  • Experience in duplex-conversational model.
  • Broader understanding of generative AI across modalities.
  • Exposure to software development best practices.
  • A flexible, experimental mindset i.e. comfortable working across research and engineering.
  • (Bonus) Publications at EMNLP, COLING, NeurIPS, ICLR, CVPR, ICCV.

Location

Preferred: San Francisco (hybrid) or London.

Remote within the U.S. or Europe available for exceptional candidates.

Similar open jobs

Remote machine learning engineer jobs (519)