Member of Technical Staff (Coding Agents)

Handshake as a Member of Technical Staff, where you'll play a crucial role in defining how frontier coding agents are benchmarked and improved. You'll collaborate with top AI researchers and software engineers to develop new benchmarks, evaluation methodologies, and data-quality techniques. This high-ownership role offers the opportunity to shape the technical direction and culture of the team, as well as contribute to the field through research and open-source tools.

Responsibilities

• Definir cómo se evalúan y mejoran los agentes de codificación de vanguardia, desarrollando nuevos estándares y metodologías de evaluación.
• Colaborar con investigadores de IA de renombre y miles de ingenieros de software para mejorar los modelos de codificación.
• Contribuir públicamente al campo a través de estándares, herramientas de código abierto, investigación y escritura técnica.

Requirements

• You’re extremely passionate about building software with agents, and regularly tinkering with the latest coding agents
• Published research on AI for Software / Code-Generation at NeurIPS, ICLR, ICML, COLM, etc
• Extensive software engineering experience or strong GitHub profile of OSS contributions, along with deep knowledge of agent harnesses
• Comfort operating in an ambiguous, fast-moving environment with substantial ownership
• At least one of the following:

Preferred

• Previous experience working on a Coding benchmark

Pay

USD 200,000 - 350,000

Benefits

• Enjoy comprehensive benefits, including health insurance, mental health support, 401k match, equity, and flexible time off.