🕒 4 days ago
Research browser behavior and develop device-identification and bot-detection techniques, taking findings from experiments through engineering implementation to improve the accuracy and stability of core products.
Conversational Modelling Research Engineer
📅 Apr 22
Large Multimodal ModelsGenerative Language ModelsVision-language ModelsDeep Learning
📜 Description
- Research large multimodal models for conversational avatars, including neural avatars and talking heads.
- Develop low-latency methods to model conversation and control avatar behavior in real time.
- Fine-tune, adapt, and condition audiovisual models for greater expressiveness, controllability, and task specificity.
- Partner with Applied ML to move research prototypes into production.
- Track emerging research and help define future directions.
🛠️ Requirements
- A PhD (or near completion) in a relevant field, or equivalent research experience.
- Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.
- Solid background in deep learning and foundation modes.
- Strong PyTorch skills and comfort building deep learning pipelines.
Full job description
About Us
Tavus is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations. AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.
Imagine a friend who can discuss any topic with you. A personal trainer that adapts to your schedule. A fleet of medical assistants that can give every patient the attention they need. With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.
We’re a Series B company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.
Be part of shaping a future where humans and machines truly understand each other.
The Role
We’re looking for an AI Researcher to join our core AI team and push the boundaries of Foundation Multimodal Conversational Models. If you thrive in fast-moving startup environments, enjoy experimenting with new ideas, and love seeing your work come to life in production then you’ll feel right at home.
Your Mission 🚀
Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g. Neural Avatars, Talking-Heads).
Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency.
Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models, more expressive, controllable, and task-specific.
Partner with the Applied ML team to take research from prototype to production.
Stay up to date with cutting-edge advancements — and help define what comes next.
You’ll Be Great At This If You Have:
A PhD (or near completion) in a relevant field, or equivalent research experience.
Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models. This could be in the context of tasks such as VQA, Audio/Video understanding tasks, captioning behavioral analysis, Translation tasks, Speech to Speech systems.
Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.
Solid background in deep learning and foundation modes.
Strong PyTorch skills and comfort building deep learning pipelines.
Nice-to-Haves
Knowledge of large-scale model training and optimization.
Experience in duplex-conversational model.
Broader understanding of generative AI across modalities.
Exposure to software development best practices.
A flexible, experimental mindset i.e. comfortable working across research and engineering.
(Bonus) Publications at EMNLP, COLING, NeurIPS, ICLR, CVPR, ICCV.
Location
Preferred: San Francisco (hybrid) or London.
Remote within the U.S. or Europe available for exceptional candidates.
Similar jobs
Search more Research Engineer jobs
📅 Aug 21
Lead hands-on research that advances health AI across training, evaluation, and biomedical capabilities, turning underdefined problems into measurable improvements in frontier models and products.
📅 Jun 22
Design and run frontier-scale reinforcement learning experiments, build benchmarks for long-horizon progress, diagnose research and infrastructure bottlenecks, and translate robust findings into production training recipes.
Research Engineer, Post-Training Model Evaluations
📅 Apr 28
Anthropic👥 10,000+ employees🏢 Research Services🤝 B2B
📅 Apr 28
Lead evaluation strategy for production model training, assess model quality as runs progress, investigate regressions, and guide teams toward trustworthy measurements that inform training and release decisions.
📅 Sep 16
Research Engineer applying frontier machine-learning research—including reinforcement learning, RLHF and LLM post-training—to build and ship capabilities for mission-critical AI platforms.