jobapplier

Software Engineer, AI Infrastructure

NVIDIA

Skills

Required

  • backend software development
  • system design
  • backend programming language
  • Kubernetes
  • cloud-native ecosystem
  • AI inference workloads
  • serving frameworks
  • performance optimization
  • Linux
  • networking
  • storage

Preferred

  • Kubernetes internals
  • OSS
  • public development process
  • open source
  • scalability
  • designing in public
  • Go

AI factories are only as good as the software that runs them.

We are looking for highly skilled software engineers to help shape the future of AI infrastructure. As a Software Engineer in the team, you will design and build scalable, high-performance systems, tackle complex distributed-systems problems, and collaborate with experts across NVIDIA and the broader community to support the next generation of AI workloads.

About NVIDIA

NVIDIA’s DSX OS turns GPU infrastructure into a shared, multi-tenant platform for AI teams, providing scheduling, orchestration, serving, and observability for AI workloads at data-center scale—from training and inference to reinforcement learning and agentic AI.The DSX OS Platform Software group builds that layer through projects such as KAI-Scheduler, Snapshot, Grove, and Run:ai.

Our work ships as open source and upstream contributions across the cloud-native and AI serving ecosystems.

We focus on performance, reliability at scale, and giving users the insight they need to understand and improve how their workloads run.

Responsibilities

  • Designing and developing open source platform components with a strong focus on performance, reliability, and scalability.
  • controllers, operators, schedulers, and APIs that orchestrate GPU workloads at scale.
  • Contributing upstream — designing in public, writing proposals, reviewing community code, and engaging with users and maintainers of the projects we work on.
  • Collaborating closely with architects, product managers, and partner teams across NVIDIA to deliver impactful solutions.
  • Writing clean, maintainable, and testable code in Go.
  • Conducting code and design reviews to uphold high-quality standards.

Requirements

  • 2+ years of experience in backend software development, including system design and architecture.
  • Proficiency in at least one backend programming language.
  • Deep familiarity with Kubernetes and the cloud-native ecosystem.
  • Demonstrated ability to solve complex technical challenges and deliver high-quality solutions.
  • Familiarity with AI inference workloads, serving frameworks, and performance optimization.
  • Proficiency in Linux, with knowledge in networking, security, storage, and virtualization.

Preferred

  • B.Sc. in Computer Science or a related field or equivalent experience.
  • Ways to stand out from the crowd: Expertise in Kubernetes internals and advanced cloud-native technologies.
  • Maintain or contribute to OSS projects, and experience working in a public development process.

Every job at NVIDIA