jobapplier

Member of Technical Staff (AI Training Infrastructure)

Fireworks AI

Skills

Required

  • ML infrastructure
  • orchestration
  • distributed training techniques
  • data parallelism
  • model parallelism
  • FSDP
  • cloud platforms
  • AWS
  • GCP
  • Azure
  • distributed systems
  • containerization
  • Kubernetes
  • Docker

Preferred

  • ML
  • multimodal AI systems
  • ML workflow orchestration tools
  • DevOps
  • open-source
  • create robust training pipelines
  • optimize distributed training workloads
  • troubleshoot complex performance issues
  • PyTorch

Join our team as a Member of Technical Staff (AI Training Infrastructure). In this role, you will design, build, and optimize the infrastructure that powers our large-scale model training operations. You will collaborate with AI researchers and engineers to create robust training pipelines, optimize distributed training workloads, and ensure reliable model development. Your work will be essential to developing high-performance AI training infrastructure.

Responsibilities

  • Design, build, and optimize the infrastructure for large-scale model training operations.
  • Collaborate with AI researchers and engineers to create robust training pipelines and optimize distributed training workloads.
  • Implement monitoring, logging, and debugging tools for training operations, and troubleshoot complex performance issues.
  • Experience with PyTorch

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience
  • Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP)
  • Proficiency in cloud platforms (AWS, GCP, Azure)
  • 3+ years of experience with distributed systems and ML infrastructure

Experience with containerization, orchestration (Kubernetes, Docker)

  • Master's or PhD in Computer Science or related field
  • Background in optimizing high-performance distributed computing systems

Preferred

  • Experience training large language models or multimodal AI systems
  • Experience with ML workflow orchestration tools
  • Familiarity with ML DevOps practices
  • Contributions to open-source ML infrastructure or related projects

Pay

USD 210,000 - 320,000