Machine Learning Quality Engineer

Join the Corporate Engineering AI team at LSEG, where you'll play a key role in scaling safe, high-quality AI capabilities across the enterprise. As a Machine Learning Quality Engineer, you'll define and implement evaluation frameworks, build and maintain automated test pipelines, and partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills. Strong Python experience and expertise in test automation are required.

Responsibilities

• Definir e implementar frameworks de avaliação para ferramentas e habilidades de MCP, abrangendo correção, segurança e impacto de regressão.
• Construir e manter pipelines de teste automatizados para comportamentos agenticos, incluindo invocação de ferramentas e fluxos de trabalho de múltiplas etapas.
• Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines
• Test automation expertise covering unit, integration, and regression testing
• Understanding of agentic system risks and failure modes

Requirements

• Produzir evidências de teste necessárias para o Permissão para Construir (PTB) e Permissão para Operar (PTO).
• Strong Python experience for test harnesses and automation
• Ability to assess solutions against governance, security, and audit expectations

Preferred

• Experience working in regulated or highly governed engineering environments