Software Engineer (AI Evaluation)

Join Board Intelligence, a company that places AI at the core of its operations. As a Software Engineer in the AI team, you will design and build the AI evaluation suite, work closely with prompt engineers and subject matter experts, and contribute to building AI-powered products. You will have the opportunity to work independently, set your own direction, and be at the forefront of AI quality.

Experience with building evaluation suites for AI products

Responsibilities

• Design and build the AI evaluation suite, including systems for measuring and improving AI output quality.
• Collaborate with prompt engineers and subject matter experts to turn their knowledge into tests, metrics, and tooling.
• Automate evaluation processes and results as part of the software development lifecycle (SDLC) to ensure product teams can ship with confidence.
• A strong focus on quality, testing and attention to detail

Requirements

• Experience collaborating with non-engineers and turning their expertise into working software
• Fluent written and spoken English
• Experience building AI powered products or tooling

Upper mid-level to senior professional software engineering experience

• We are looking for a strong all-round engineer who is comfortable working independently, enjoys ambiguity and wants to work at the forefront of AI quality
• Comfort working independently and in ambiguity, setting your own direction

Full-stack experience across front end and back end

• Experience using AI coding tools in your day-to-day work
• Experience building internal tools, testing frameworks or data pipelines
• Experience with Python and TypeScript

Preferred

• Experience at a startup or in a small team where you built things end to end