jobapplier

Software Architect

SambaNova Systems

Skills

Required

  • distributed systems
  • architectures
  • software engineering
  • observability
  • building backend systems
  • Python / Go / Rust
  • AI inference serving
  • orchestration

Preferred

  • ML
  • optimization
  • productionization
  • AI coding assistants
  • Lead design reviews
  • Kubernetes

Join SambaNova, a leading AI infrastructure company, as a Software Architect for the SambaStack platform. In this high-impact role, you will define the technical direction of the platform, shape its evolution to meet enterprise AI workload demands, and own cross-cutting architectural decisions. You will work at the intersection of AI infrastructure, enterprise software, systems architecture and design, and developer experience.

Define the technical direction of the SambaStack platform, shaping its evolution to meet enterprise AI workload demands.

Responsibilities

  • Own the end-to-end technical architecture of the SambaStack inference platform, ensuring it meets enterprise-grade standards for scalability, reliability, and performance.
  • Lead design reviews for major new capabilities and cross-cutting system changes, providing authoritative technical guidance and raising the quality bar across the engineering organization.
  • Expert-level understanding of Kubernetes, including Operators, Helm Charts, and cluster-scale resource management

Requirements

  • 12+ years of software engineering experience, including significant time in a role with organization-wide technical influence
  • Strong command of distributed systems principles: consistency, fault tolerance, observability, and performance at scale
  • Excellent written and verbal communication skills: Able to clearly articulate complex architectural decisions to both engineering and non-technical audiences
  • Demonstrated experience setting technical direction across multiple teams and driving cross-functional alignment
  • Expertise building backend systems in Python, Go, or Rust
  • Proven track record of owning large-scale distributed systems architectures end-to-end from design to production
  • Track record of mentoring more junior engineers and elevating team-wide engineering quality
  • Deep familiarity with AI inference serving, orchestration, and the infrastructure challenges of LLM workloads at production scale
  • Experience designing systems for custom or novel hardware accelerators (e.g., dataflow architectures, GPUs, TPUs)
  • Experience building cloud-native platforms for enterprise customers with stringent SLA and compliance requirements

Preferred

  • Background in ML application optimization and productionization
  • Experience at a high-growth AI infrastructure company
  • Familiarity with AI coding assistants and the developer tooling ecosystem

Pay

USD 245,000 - 325,000