Multimodal AI Model Optimization Research Engineer
Tavus
- United States
- Mid Level
- Posted
Skills
Required
- model optimization
- distillation
- pruning / sparsification
- quantization
- Runtime / TVM / Triton / XLA
- ML
- reproduce results
- GPU / accelerator
- Python coding
- PyTorch
Preferred
- TTS / video
- real-time or streaming systems
- low-latency APIs
- WebRTC
- streaming
- experiment tracking
- benchmarking
- profiling at scale
Join our core AI team as a Multimodal AI Model Optimization Research Engineer. In this role, you will optimize cutting-edge research models for production using techniques such as sparsification, distillation, and quantization. You will own the optimization lifecycle for key models, define metrics, run experiments, and benchmark trade-offs across latency, cost, and quality. You will collaborate closely with researchers and engineers to turn new ideas into deployable systems.
Prendre des modèles de recherche de pointe et les rendre rapides, efficaces et prêts pour la production en utilisant la sparsification, la distillation et la quantification.
About Tavus
- Collaborer étroitement avec les chercheurs et les ingénieurs pour transformer de nouvelles idées en systèmes déployables.
- Our ideal partner-in-crime thrives in startup environments, is comfortable prioritizing independently, and is willing to take calculated risks
- We’re moving fast and looking for people who can help pave the path
Responsibilities
- Posséder le cycle de vie de l'optimisation pour des modèles clés : définir des métriques, réaliser des expériences et évaluer les compromis entre la latence, le coût et la qualité.
Requirements
- Ability to read ML papers, reproduce results, and adapt ideas
Clear communication and collaboration skills
- Strong understanding of inference performance and GPU/accelerator fundamentals
- Strong Python coding skills and reliable research engineering practices
- Experience working with large models and datasets in cloud environments
- Hands-on experience with model optimization and compression, including knowledge distillation, pruning/sparsification, quantization, and mixed precision
- Understanding of efficient architectures such as low-rank adapters
Strong experience in deep learning using PyTorch
- Optimization of diffusion models, video/audio generative models, or large language models
- Familiarity with TensorRT, ONNX Runtime, TVM, Triton, or XLA
- Experience writing custom Triton/CUDA kernels or low-level performance tuning
Preferred
- Experience with real-time or streaming systems (low-latency APIs, WebRTC, streaming TTS/video)
- Experience with experiment tracking, benchmarking, and profiling at scale
- Prior experience in research engineering or applied science roles
Benefits
- This position offers comprehensive benefits, unlimited paid time off, flexible hours, and a remote-friendly work environment.
jobapplier