Staff + Senior Software Engineer (Cloud Inference Launch Engineering)

Join Anthropic, a leading AI safety and research company, as a Staff + Senior Software Engineer in the Cloud Inference Launch Engineering team. You will be responsible for scaling and optimizing Claude, our AI model, to serve developers and enterprise companies across multiple cloud platforms. Your work will directly impact the speed at which new models and features are launched, and you will have the opportunity to drive innovation in the field of AI.

Not all strong candidates will meet every single qualification as listed

Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work

About Anthropic

Are a fast learner who can quickly ramp up on new technologies, hardware platforms, and provider ecosystems

We encourage you to apply even if you do not believe you meet every single qualification

We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team

Responsibilities

• Conception, construction, and ownership of the CI/CD infrastructure for the inference server and load balancer across cloud platforms.
• Identification and resolution of gaps that cause inference behavior discrepancies across first-party and cloud service providers.
• Collaboration with the core inference team to integrate new inference features into cloud platforms and ensure their production readiness.
• Thrive in cross-functional collaboration with both internal teams and external partners
• Capacity-constrained scheduling or shared-resource test infrastructure
• Solid understanding of multi-region deployments, request routing, load balancing, global traffic management
• LLM inference optimization, batching, and caching strategies

Requirements

• Are highly autonomous and take ownership of problems end-to-end, including work that falls outside your job description
• Have a strong interest in LLM serving; prior inference or ML experience is not required
• Have a track record of building automation or test infrastructure that measurably improved release velocity or reliability
• Have significant software engineering experience, with a strong background in high-performance, large-scale distributed systems serving millions of users
• Have experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure), with exposure to Kubernetes, Infrastructure as Code, or container orchestration
• Proficiency in Python or Rust
• Working with CSP partner teams to scale infrastructure across multiple platforms, navigating differences in networking, security, privacy, and managed service

Pay

USD 320,000 - 485,000