Software Engineer (Agentic Runtime)

Join the Agentic Runtime team as a Software Engineer, where you'll design and operate core runtime services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety. You'll work across distributed systems, production observability, and ML infra integrations to deliver an instant, accurate, and trustworthy experience while optimizing cost and reliability. You'll own impactful runtime problems end-to-end, build and evolve core services, and collaborate closely with product, quality, and application teams.

Responsibilities

• Design and operate core runtime services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety.
• Build and evolve core services for session lifecycle, streaming responses (e.g., gRPC/WebSockets), structured tool execution, memory/state, and policy/guardrails.
• Integrate with leading LLM providers (e.g., OpenAI, Anthropic, Google Gemini) and internal evaluation frameworks to improve quality and predictability.

Requirements

• Experience operating services on Kubernetes and at least one major cloud (e.g., GCP, AWS, or Azure)
• Background in one or more areas is a plus: policy/guardrails, multi‑tenant isolation, rate‑limiting, concurrency control, cost optimization
• Practical understanding of LLM/agents building blocks: tool/function calling, structured outputs, streaming, and model selection/routing
• 3+ years of software engineering experience building production distributed systems or cloud‑native applications
• Ownership‑driven with a positive, proactive attitude; comfortable leading projects or learning from battle‑tested engineers
• Familiarity with event/streaming systems (e.g., Pub/Sub, Kafka), caching (e.g., Redis), and data stores for low‑latency paths
• Product‑minded: you prioritize customer impact, clear SLAs/SLOs, and pragmatic iteration
• BS/BA in Computer Science or related field, or equivalent practical experience
• Strong coding skills in at least one of: Python, Go, Java, Javascript, Typescript, C++, with a focus on reliability, performance, and tests
• Strong observability and debugging skills: tracing (e.g., OpenTelemetry), metrics, dashboards, and production forensics

Pay

USD 180,000 - 210,000