Research Intern (Inference, Winter 2027)
Together AI
- San Francisco, United States
- Internship
- Intern/New Grad
- Posted
Join the Inference Research team as a Research Intern for Winter 2027. You will work on building efficient, scalable, and reliable serving systems for large foundation models. Your tasks will include co-designing and implementing cross-layer optimizations, conducting rigorous experiments, and documenting findings. This internship offers a competitive benefits package and the opportunity to work alongside industry-leading engineers and researchers.
Contributions to open-source machine learning projects
Responsibilities
- Participer à la conception et à la mise en œuvre d'optimisations croisées entre les modèles, les systèmes et le matériel, en mettant l'accent sur des domaines tels que la conception du cache KV et les architectures de service à grande échelle.
- Concevoir et réaliser des expériences rigoureuses pour valider des hypothèses, et communiquer les plans, les progrès et les résultats des projets à l'équipe.
- Documenter les résultats dans des publications scientifiques et des articles de blog, et contribuer à la mission d'avancement de l'IA ouverte et transparente.
Requirements
Strong programming skills in Python
- Experience with deep learning frameworks (PyTorch, JAX, etc.)
- Familiarity with Transformer architectures and recent developments in foundation models
- Currently pursuing a final year of Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Understanding of model optimization techniques and hardware acceleration approaches
Preferred
- Prior research experience in foundation models, efficient machine learning, or ML systems
- Publications at leading conferences in machine learning or systems (i.e., MLSys, ICLR)
- Experience with CUDA programming (for kernel development)
