Staff+ Software Engineer (Account Creation)
- New York, United States
- Lead/Staff
- 8+ years
- Bachelor's degree
- Posted
Skills
Required
- integrity / spam / fraud / abuse detection
- Software Engineering
- Python
- Typescript
- AI/ML systems
- prompt engineering
- jailbreak attacks
Join Anthropic, an AI safety and research company, as a Staff+ Software Engineer on the Safeguards team. In this role, you will build systems to monitor AI models, prevent misuse, and ensure user well-being. You will develop monitoring systems, build abuse detection mechanisms, and create multi-layered defenses for real-time safety improvements. Enjoy comprehensive benefits, a competitive salary, and the opportunity to work on impactful AI safety initiatives.
Responsibilities
- Develop monitoring systems to detect unwanted behaviors from API partners and potentially take automated enforcement actions.
- Build abuse detection mechanisms and infrastructure, and surface abuse patterns to research teams to harden models.
- Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale.
Requirements
- An ability to work across the stack
Proficiency in Python and Typescript
- A Bachelor’s degree in Computer Science, Software Engineering or comparable experience
- Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
- Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
- Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
- Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
- We encourage you to apply even if you do not believe you meet every single qualification
- 8+ years of experience in a software engineering position
- Have experience with integrity, spam, fraud, or abuse detection and mitigation
- Have experience building trust and safety detection mechanisms and intervention for AI/ML systems
- Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
- Have worked closely with operational teams to build custom internal tooling
Pay
USD 320,000 - 485,000
