Member of Technical Staff (AI Training Infrastructure)
Fireworks AI
- United States
- Lead/Staff
- 3+ years
- Bachelor's degree
- Posted
Skills
Required
- ML infrastructure
- orchestration
- distributed training techniques
- data parallelism
- model parallelism
- FSDP
- cloud platforms
- AWS
- GCP
- Azure
- distributed systems
- containerization
- Kubernetes
- Docker
Preferred
- ML
- multimodal AI systems
- ML workflow orchestration tools
- DevOps
- open-source
- create robust training pipelines
- optimize distributed training workloads
- troubleshoot complex performance issues
- PyTorch
Join our team as a Member of Technical Staff (AI Training Infrastructure). In this role, you will design, build, and optimize the infrastructure that powers our large-scale model training operations. You will collaborate with AI researchers and engineers to create robust training pipelines, optimize distributed training workloads, and ensure reliable model development. Your work will be essential to developing high-performance AI training infrastructure.
Responsibilities
- Design, build, and optimize the infrastructure for large-scale model training operations.
- Collaborate with AI researchers and engineers to create robust training pipelines and optimize distributed training workloads.
- Implement monitoring, logging, and debugging tools for training operations, and troubleshoot complex performance issues.
- Experience with PyTorch
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience
- Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP)
- Proficiency in cloud platforms (AWS, GCP, Azure)
- 3+ years of experience with distributed systems and ML infrastructure
Experience with containerization, orchestration (Kubernetes, Docker)
- Master's or PhD in Computer Science or related field
- Background in optimizing high-performance distributed computing systems
Preferred
- Experience training large language models or multimodal AI systems
- Experience with ML workflow orchestration tools
- Familiarity with ML DevOps practices
- Contributions to open-source ML infrastructure or related projects
Pay
USD 210,000 - 320,000
