jobapplier

Staff Backend Software Engineer (Product)

Otter.ai

Skills

Required

  • system design
  • data-intensive or distributed systems
  • designing systems
  • latency
  • user feedback loops
  • experimentation
  • frameworks

Preferred

  • evaluation
  • LLM-powered
  • RAG

Join our team as a Staff Backend Software Engineer (Product) and play a key role in shaping the architecture and systems behind our AI-driven product experiences. You will define how AI capabilities are translated into scalable systems, drive technical direction across product areas, and partner closely with product, design, and AI teams. This is a unique opportunity to influence engineering quality, system design, and product thinking beyond your immediate team.

Responsibilities

  • Definir la arquitectura del sistema para superficies de productos nativos de IA y diseñar sistemas fundamentales que alimenten múltiples áreas de productos.
  • Impulsar la estrategia técnica interequipos y liderar iniciativas que abarcan equipos de producto, IA e infraestructura, asegurando la alineación en la arquitectura y la ejecución.
  • Establecer las mejores prácticas para la ingeniería de productos de IA y establecer estándares sobre cómo construir con IA, cubriendo áreas como la evaluación, la fiabilidad y el diseño del sistema.

Requirements

  • Has a strong track record of owning technical and product direction for large or ambiguous problem spaces
  • Is comfortable operating at a high level of ambiguity and defining both the problem and the solution
  • Has 10+ years of experience building and scaling complex systems
  • Has experience leading cross-team initiatives and influencing without direct authority
  • Demonstrates deep expertise in system design, especially in data-intensive or distributed systems
  • Brings strong product intuition and can balance user experience, system constraints, and business impact
  • Experience designing systems that balance latency, cost, and quality
  • Exposure to user feedback loops, experimentation, or evaluation frameworks

Preferred

  • Experience building or experimenting with LLM-powered features (prompting, evaluation, RAG, etc.)

Pay

USD 210,000 - 250,000