Senior Software Engineer (GPU Infrastructure, High Performance Computing)

Join Cohere, a leading AI company, as a Senior Software Engineer specializing in GPU Infrastructure and High Performance Computing. You will work closely with AI researchers to build and operate superclusters across multiple clouds, optimize infrastructure for AI/ML training, troubleshoot complex issues, and drive innovation in ML infrastructure. Enjoy a range of benefits including six weeks of paid vacation, equity options, comprehensive insurance coverage, and a remote work culture.

Construire et gérer des superclusters basés sur Kubernetes pour les charges de travail d'IA.

If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

Responsibilities

• Collaborer avec les fournisseurs de cloud pour optimiser l'infrastructure pour l'efficacité des coûts, la fiabilité et la performance.
• Travailler en étroite collaboration avec les chercheurs en IA pour comprendre les besoins émergents et traduire ces besoins en solutions d'infrastructure robustes.
• Self-directed problem-solving: The ability to identify bottlenecks, propose solutions, and drive impact in a fast-paced environment
• Kubernetes at scale: Proven ability to deploy, manage, and troubleshoot cloud-native Kubernetes clusters for AI workloads
• Research collaboration experience: A track record of working closely with AI researchers or ML engineers to solve infrastructure challenges

Requirements

• Low-level systems knowledge: Familiarity with Linux internals, RDMA networking, and performance optimization for ML workloads
• Deep expertise in ML/HPC infrastructure: Experience with GPU/TPU clusters, distributed training frameworks (JAX, PyTorch, TensorFlow), and high-performance computing (HPC) environments

Preferred

• Strong programming skills: Proficiency in Python (for ML tooling) and Go (for systems engineering), with a preference for open-source contributions over reinventing solutions