jobapplier

Research Engineer - Tokenizer & Protocols

Mistral Ai

Skills

Preferred

  • tokenization
  • model interfaces
  • Mistral, a leading AI solutions provider, as a Research Engineer specializing in tokenization and protocols.
  • Ideal candidates will have a strong software engineering background, excellent understanding of tokenizers, and experience building production-grade libraries.

Responsibilities

  • In this role, you will design, build, and maintain core libraries for tokenization and model interfaces, evolving our formats and tokenizers as models and use cases change.
  • You will work across the entire stack, impacting every model we ship.
  • Design, build and maintain core libraries for tokenization and model interfaces.
  • Evolve formats and tokenizers as models and use cases change, ensuring compatibility across the stack.
  • Turn research needs into robust, shared tooling, facilitating training, evaluation, and production processes.

Requirements

  • This position is primarily based in Europe, with remote options available in specific countries.