Multimodal AI Model Optimization Research Engineer

ABOUT US

Tavus is at the forefront of integrating human interaction with artificial intelligence. Our goal is to make AI communication as seamless as in-person conversations, enhancing areas previously lacking scalability. Through innovative research in multimodal AI, we focus on understanding and simulating human communication—encompassing language, audio, and video. Our technology enables a range of applications, including text-to-video avatars and real-time conversational experiences in sectors like healthcare, recruitment, sales, and education. Backed by prominent investors such as Sequoia, Y Combinator, and Scale VC, we are shaping the future of AI interactions.

THE ROLE

We are seeking a skilled Research Scientist/Engineer specializing in model optimization to become a vital part of our AI team. The ideal candidate thrives in a dynamic startup environment, is proactive in setting priorities, and embraces calculated risks as we move rapidly towards our goals.

YOUR MISSION

• Enhance advanced research models to improve speed, efficiency, and readiness for production through techniques like sparsification and quantization.
• Manage the optimization process for key models, setting metrics, conducting experiments, and evaluating trade-offs in latency, cost, and quality.
• Collaborate closely with researchers and engineers to transform innovative concepts into deployable solutions.

REQUIREMENTS

• Proficient in deep learning with PyTorch.
• Hands-on experience in model optimization techniques.
• Familiarity with efficient architectures and inference performance.
• Strong Python skills and research engineering background.
• Experience handling large models and datasets in cloud settings.
• Effective communication and teamwork abilities.

PREFERRED EXPERIENCE

• Optimization of diffusion or generative models.
• Familiarity with real-time systems and performance tuning.
• Experience with experiment tracking and profiling.

LOCATION

This role is ideally based in San Francisco, with support for relocation available. Remote candidates will also be considered.

BENEFITS

At Tavus, we foster a supportive family environment, offering flexible schedules, unlimited PTO, competitive healthcare options, and a focus on collaboration and impact.

CULTURE & DIVERSITY

We seek culture creators, valuing diversity as a key to our success. Varied backgrounds and perspectives enhance our ability to deliver exceptional client experiences.