jobapplier

Member of Technical Staff (Post-Training)

Handshake

Skills

Required

  • training / inference / data / evaluation
  • post-training / fine-tuning / model-evaluation
  • ML
  • Python
  • designing systems—not
  • RL / SFT / LoRA / PEFT / full fine-tuning / RLHF / DPO / PPO / reward modeling / training environments
  • open-source
  • AI research

Preferred

  • modern ML tooling
  • PyTorch
  • evaluation workflows
  • LLM/agent benchmarks / evaluation methodologies / annotation systems / data-quality frameworks
  • reinforcement learning / alignment / model behavior / synthetic data / human-in-the-loop systems
  • diagnose failures

Join our team as a Member of Technical Staff, Post-Training. In this high-ownership role, you will define and build a new organization focused on model improvement and reliable systems. You will partner with researchers, domain experts, and customers to turn ambiguous post-training questions into experiments, evaluation frameworks, data pipelines, and products. Your work will have a significant impact on our technical direction, operating culture, and the reusable systems we build.

About Handshake

We care more about demonstrated research capability, technical judgment, and a builder’s mindset than a specific title, degree, or career path

Responsibilities

  • Definir y construir una nueva organización enfocada en la mejora de modelos de inteligencia artificial, trabajando en estrecha colaboración con investigadores y expertos en el dominio.
  • Diseñar sistemas y metodologías de post-entrenamiento para modelos de frontera, incluyendo el ajuste fino supervisado, el aprendizaje por refuerzo y la optimización de preferencias.
  • Identificar patrones repetibles en los compromisos y convertirlos en software y plataformas reutilizables, contribuyendo a la mejora continua de los sistemas.
  • Sound experimental judgment: you can form hypotheses, choose meaningful metrics, diagnose failures, and distinguish signal from noise

Requirements

  • Comfort operating in an ambiguous, fast-moving environment with substantial ownership
  • Strong Python skills and the ability to write clean, efficient, scalable software
  • Experience designing systems—not only implementing specifications—including the ability to make tradeoffs around quality, scale, reliability, and reuse
  • 3+ years of demonstrated strength in post-training, fine-tuning, or model-evaluation work. Relevant experience may include RL, SFT, LoRA/PEFT, full fine-tuning, RLHF, DPO, PPO, reward modeling, or training environments
  • Collaborative, low-ego communication and the ability to work effectively with researchers, engineers, domain experts, and customers
  • Building or operating large-scale ML training, inference, data, or evaluation systems
  • Published research, meaningful open-source contributions, or evidence of technical leadership in ML systems or AI research

Preferred

  • Hands-on experience with modern ML tooling, particularly PyTorch and large-scale data, training, or evaluation workflows
  • Developing LLM/agent benchmarks, evaluation methodologies, annotation systems, or data-quality frameworks
  • Research or applied work on reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems
  • Experience productizing research or repeated customer work into robust, reusable platforms

Pay

USD 200,000 - 350,000