jobapplier

Senior Software Development Engineer in Test

Qualia

Skills

Required

  • unit / integration / API / UI / performance / agentic layer
  • test infrastructure / developer tooling / platform engineering / observability / release engineering
  • APIs
  • JavaScript / TypeScript
  • automation
  • CI/CD
  • release orchestration
  • LLMs / AI-assisted engineering / agentic systems
  • agent workflows
  • multi-step AI workflows
  • software engineering
  • system design
  • Node.js
  • Microservice architecture / Kubernetes
  • Jenkins / GitHub Actions / ArgoCD / Spinnaker / Harness

Preferred

  • tool/function calling
  • LLM APIs
  • agent frameworks
  • structured outputs
  • RAG/context retrieval
  • LLM
  • telemetry
  • CI/CD systems / developer platforms
  • structured logging
  • MongoDB

Join our team as a Senior Software Development Engineer in Test (SDET) and help build the next generation of intelligent products. You will be responsible for building test infrastructure, AI/ML evaluation systems, agentic validation harnesses, and observability platforms. You will work closely with engineering and quality leadership, mentor engineers, and make technical decisions on frameworks, architecture, and validation strategies. This is a unique opportunity to work in the fast-changing domain of artificial intelligence and make a significant impact on the industry.

Concevoir et construire des systèmes d'infrastructure de test, des systèmes d'évaluation AI/ML, des systèmes de validation agentique, des outils d'orchestration de version, d'observabilité et de test de performance.

THE TECH STACK YOU'LL USE

Locust / Gatling / JMeter / k6 (performance testing)

Responsibilities

  • Collaborer avec les ingénieurs logiciels, les ingénieurs qualité, les SRE et les équipes de plateforme pour rendre ces capacités réutilisables et mentoriser les ingénieurs sur l'architecture des tests, l'observabilité et l'ingénierie assistée par l'IA.
  • Appliquer l'IA aux problèmes de qualité d'ingénierie, y compris la génération de tests, le triage des tests instables, le regroupement des échecs et l'analyse des risques de version.
  • Experience building or scaling CI/CD systems, release orchestration, test infrastructure, or developer platforms, and designing observability/telemetry systems using structured logging, metrics, and distributed tracing
  • Experience or familiarity with LLM and agent evaluation, including evaluation datasets, deterministic and model-based evaluators, and the unique challenges of testing probabilistic/non-deterministic systems
  • Postman / REST Assured (API testing)
  • Datadog, OpenTelemetry (observability & telemetry)
  • MongoDB
  • Playwright (browser & test automation)

Requirements

  • Hands-on experience with LLMs, AI-assisted engineering, or agentic systems beyond simply using an AI coding assistant, including tool/function calling, agent workflows, and multi-step AI workflows
  • Strong software engineering fundamentals including system design, distributed systems, APIs, asynchronous systems, and production operations
  • Strong programming ability in JavaScript/TypeScript, including designing backend services, libraries, frameworks, and production-quality infrastructure from scratch
  • Strong understanding of the testing pyramid and experience determining when validation belongs at the unit, integration, API, UI, performance, or agentic layer
  • 5+ years of experience as an SDET or software engineer building test infrastructure, developer tooling, platform engineering, observability, or release engineering systems—not primarily writing test cases or automation scripts
  • Comfortable mentoring engineers and raising the technical quality bar across teams
  • JavaScript / Node.js / TypeScript
  • AWS / Google Cloud
  • Microservice architecture / Kubernetes
  • Jest (unit/integration testing)
  • Jenkins / GitHub Actions / ArgoCD / Spinnaker / Harness (CI/CD & release orchestration)

Preferred

  • LLM APIs, tool/function calling, agent frameworks, structured outputs, RAG/context retrieval