Evaluation Engineer, Applied AI
- Paris, France
- Mid Level
- 3+ years
- Posted
Skills
Required
- machine learning systems
- Python coding
- machine learning concepts
Preferred
- create custom evaluation suites
- LLM
Mistral, a leading provider of full-stack AI solutions. As an Evaluation Engineer on the Applied AI team, you will play a crucial role in shaping how enterprise customers measure and trust AI solutions. You will design and implement evaluation frameworks, build scalable infrastructure, and collaborate with customers to create custom evaluation suites.
Responsibilities
- Design and implement comprehensive frameworks to evaluate large language model (LLM) performance across customer use cases.
- Build and maintain scalable evaluation infrastructure and pipelines for rapid, reproducible assessment.
- Collaborate with customers to create custom evaluation suites that fit their unique needs and criteria.
Requirements
- This position requires at least 3 years of experience in evaluating machine learning systems, strong Python coding skills, and a deep understanding of machine learning concepts.
- Mistral offers a comprehensive benefits package and a dynamic, collaborative work environment.
