jobapplier

AI Research Scientist

MakiPeople

Join Maki People, a company focused on improving hiring decisions through science and AI. As an AI Research Scientist, you will work at the intersection of AI, psychometrics, and research, ensuring that Maki's automated scoring systems are scientifically robust, fair, and continuously improving. Your responsibilities will include evaluating and testing LLMs for scoring, building scoring models, comparing AI with human judgment, analyzing bias and fairness, conducting predictive analytics, and producing research output.

Responsibilities

  • Evaluating and testing large language models (LLMs) for scoring, benchmarking models across assessment types and languages.
  • Building and fine-tuning scoring models on expert-rated data, ensuring accuracy, reliability, and fairness.
  • Designing studies to compare AI scores with expert ratings, developing hybrid scoring pipelines that combine human oversight with AI scoring.