jobapplier

Senior Software Engineer (Backend, Product)

Otter.ai

Skills

Required

  • AI / LLM-powered
  • ramp quickly
  • designing systems
  • latency
  • user feedback loops
  • experimentation
  • frameworks

Preferred

  • evaluation
  • RAG
  • system design
  • architecting systems
  • Python
  • modern web stack

Join our team as a Senior Software Engineer (Backend, Product) and take ownership of significant areas of our AI-driven product. You will work across the full lifecycle of AI features, from data ingestion to delivery into user-facing surfaces. You will also design the systems that power these features, ensuring reliability and performance. Additionally, you will mentor other engineers and help elevate the team's overall quality.

Responsibilities

  • End-to-end delivery of AI product features, leading the design and implementation of complex features.
  • Driving system design for AI-backed experiences, architecting systems that orchestrate LLMs, retrieval, and structured data.
  • Mentoring and raising the engineering bar, providing guidance on code quality, system design, and product thinking.
  • Writes clean, maintainable code (Python preferred) and makes strong architecture and design decisions across a modern web stack

Requirements

  • Brings a high bar for product quality, not just system correctness — consistently asks whether what's being built actually serves users well
  • Thrives in ambiguous, fast-moving environments and can set technical direction, not just execute within it
  • Drives projects from idea → production with strong ownership, and helps others do the same through mentorship and technical leadership
  • Has 5+ years of experience building and scaling product-facing systems, with a track record of owning complex features or product areas end-to-end
  • Has experience working with AI/LLM-powered systems, or can ramp quickly and contribute meaningfully to shaping their behavior in production
  • Experience designing systems that balance latency, cost, and quality
  • Exposure to user feedback loops, experimentation, or evaluation frameworks

Preferred

  • Experience building or experimenting with LLM-powered features (prompting, evaluation, RAG, etc.)

Pay

USD 185,000 - 230,000