Senior Software Engineer (Backend, Product)
Otter.ai
- Mountain View, United States
- Senior Level
- 5+ years
- Posted
Skills
Required
- AI / LLM-powered
- ramp quickly
- designing systems
- latency
- user feedback loops
- experimentation
- frameworks
Preferred
- evaluation
- RAG
- system design
- architecting systems
- Python
- modern web stack
Join our team as a Senior Software Engineer (Backend, Product) and take ownership of significant areas of our AI-driven product. You will work across the full lifecycle of AI features, from data ingestion to delivery into user-facing surfaces. You will also design the systems that power these features, ensuring reliability and performance. Additionally, you will mentor other engineers and help elevate the team's overall quality.
Responsibilities
- End-to-end delivery of AI product features, leading the design and implementation of complex features.
- Driving system design for AI-backed experiences, architecting systems that orchestrate LLMs, retrieval, and structured data.
- Mentoring and raising the engineering bar, providing guidance on code quality, system design, and product thinking.
- Writes clean, maintainable code (Python preferred) and makes strong architecture and design decisions across a modern web stack
Requirements
- Brings a high bar for product quality, not just system correctness — consistently asks whether what's being built actually serves users well
- Thrives in ambiguous, fast-moving environments and can set technical direction, not just execute within it
- Drives projects from idea → production with strong ownership, and helps others do the same through mentorship and technical leadership
- Has 5+ years of experience building and scaling product-facing systems, with a track record of owning complex features or product areas end-to-end
- Has experience working with AI/LLM-powered systems, or can ramp quickly and contribute meaningfully to shaping their behavior in production
- Experience designing systems that balance latency, cost, and quality
- Exposure to user feedback loops, experimentation, or evaluation frameworks
Preferred
- Experience building or experimenting with LLM-powered features (prompting, evaluation, RAG, etc.)
Pay
USD 185,000 - 230,000
