Software Engineer – ML Infrastructure
People Culture Talent
- San Francisco, United States
- On-site
- $150K – $350K /yr
- Mid Level
- Posted
Skills
Required
- distributed systems
- software engineering
- machine learning infrastructure
- PyTorch
- model serving engines
- distributed training frameworks
- compute environments
- GPU-based workloads
- reinforcement learning
- RL
- post-training infrastructure / RLHF / automated model evaluation pipelines
- modern machine learning frameworks
- systems design
- debugging
Preferred
- Infrastructure
- machine learning models
- training infrastructure
- production model deployment
- large language model workloads
- scheduling
ML Infrastructure Software Engineer to build and improve infrastructure for machine learning workloads. You’ll partner with researchers and engineers to support experimentation, training, evaluation, and production deployment, with a focus on reliability and performance.
About People Culture Talent
Note: We are recruiting on behalf of our valued client. This opportunity is for a position with their organization, not with People Culture Talent. We're excited to help connect talented professionals with this exceptional team!
Responsibilities
- Design and build infrastructure for model training and production serving.
- Develop reliable pipelines and shared tools that help teams run and manage machine learning workloads.
- Improve compute utilization, workload scheduling, and performance across distributed systems.
- Use profiling and monitoring to identify bottlenecks, troubleshoot failures, and guide improvements.
- Automate testing and measurement to help teams assess changes consistently.
- Lead architectural decisions, explain trade-offs, and carry projects from initial design through deployment and ongoing operation.
- Collaborate with researchers and engineering teams to turn evolving requirements into maintainable systems.
Requirements
- Substantial software engineering experience with technical ownership at Senior Engineer level or equivalent.
- A track record of personally designing, building, and operating core machine learning infrastructure.
- Hands-on experience with PyTorch, model serving engines, and distributed training frameworks
- Strong experience with distributed systems and large-scale compute environments, including GPU-based workloads.
- Solid background in reinforcement learning (RL) post-training infrastructure, RLHF, or automated model evaluation pipelines
- Practical experience with modern machine learning frameworks and their supporting infrastructure.
- Strong systems design, debugging, and performance optimization skills.
- Clear, concise communication and the ability to explain your contributions, architectural choices, and technical trade-offs.
- Experience owning systems over time, including maintenance, reliability, and improvements as requirements evolve.
Preferred
- Experience supporting both training infrastructure and production model deployment.
- Experience with large language model workloads is a plus, but not required. Infrastructure experience with other types of machine learning models is equally relevant.
