jobapplier

Staff Software Engineer (Inference)

Anthropic

Skills

Required

  • distributed systems
  • LLM inference optimization
  • batching strategies
  • Python / Rust
  • software engineering

Preferred

  • machine learning systems
  • infrastructure
  • optimization
  • machine learning
  • LLM inference
  • batching
  • Load balancing / request routing / traffic management systems
  • performance optimization
  • service orchestration
  • Kubernetes

Join our Inference team as a Staff Software Engineer, where you will be responsible for building and maintaining critical systems that serve our AI model, Claude, to millions of users worldwide. You will work on complex distributed systems challenges, optimize compute efficiency, and enable breakthrough AI research. The role offers comprehensive benefits, a competitive salary, and opportunities for professional growth.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed

Responsibilities

  • Conception et mise en œuvre d'algorithmes de routage intelligents pour optimiser la distribution des requêtes.
  • Autoscaling de notre flotte de calcul pour s'adapter dynamiquement à l'offre et à la demande.
  • Conception de pipelines de déploiement de production pour la mise en service de nouveaux modèles.
  • Strong candidates should have familiarity with performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing
  • Implementing and deploying machine learning systems at scale
  • LLM inference optimization, batching, and caching strategies
  • Kubernetes and cloud infrastructure (AWS, GCP)
  • Load balancing, request routing, or traffic management systems

Requirements

  • Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments is highly encouraged but not strictly necessary
  • High-performance, large-scale distributed systems
  • Python or Rust

Care about the societal impacts of your work

  • Have significant software engineering experience, particularly with distributed systems
  • Are results-oriented, with a bias towards flexibility and impact
  • Pick up slack, even if it goes outside your job description
  • Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience

Preferred

  • Want to learn more about machine learning systems and infrastructure

Pay

EUR 295,000 - 355,000

Benefits

  • Thrive in environments where technical excellence directly drives both business results and research breakthroughs

Every job at Anthropic