jobapplier

Project Manager (Applied AI)

Lilt

Skills

Required

  • AI
  • LLM
  • project management
  • Agile / Scrum / Kanban
  • Excel/Google Sheets
  • SQL
  • LLM training processes
  • SFT
  • RLHF
  • evaluation methodologies
  • Jira

Preferred

  • ML Engineering
  • Data Science
  • AI data
  • Oversee large-scale data pipelines
  • multilingual data collection
  • LLM evaluation

Join our team as a Project Manager (Applied AI) where you will lead large-scale multilingual data collection and Large Language Model (LLM) evaluation initiatives. You will manage the full lifecycle of AI data projects, oversee large-scale data pipelines, track key performance indicators, and coordinate globally with data experts and crowd pools.

Responsibilities

  • You will also collaborate cross-functionally with Applied AI Technical Ops teams and facilitate continuous feedback loops.
  • Manage the full lifecycle of AI data projects, from scoping and guidelines creation to data delivery and post-mortem analysis.
  • Oversee large-scale data pipelines for multilingual data collection and LLM evaluation, ensuring adherence to SLAs regarding localized nuances and linguistic accuracy.
  • Monitor and report on key performance indicators, including throughput, quality, and productivity, while maintaining dashboards to visualize project health.
  • If you thrive in a fast-paced environment where you can optimize workflows for productivity, quality, and throughput, we want to hear from you

Requirements

  • Methodology: Proven track record using Agile, Scrum, or Kanban methodologies to manage complex workflows
  • Communication: Exceptional ability to write clear, unambiguous guidelines for multilingual audiences
  • Data Proficiency: Advanced proficiency in Excel/Google Sheets; ability to write SQL queries to extract and analyze performance data
  • LLM Knowledge: Strong understanding of LLM training processes (Pre-training, SFT, RLHF) and evaluation methodologies (Human-in-the-loop, red teaming)
  • Experience: 3-5+ years of project management experience, specifically within AI/ML data operations
  • Technical Tools: Experience with data annotation platforms (e.g. Scale AI, Super Annotate) and project management tools (e.g. Jira)

Preferred

  • Multilingual: Fluency in a second language is highly desirable
  • Education: Background in ML Engineering, Computer Science, Data Science and Project Management training

Benefits

  • Benefits include medical coverage, paid parental leave, a monthly lifestyle benefit stipend, meaningful equity, 401(k) matching, and flexible time off.