Perception Engineer (Multimodal & Embodied AI)
- San Diego, United States
- Mid Level
- PhD or doctorate
- Posted
Skills
Required
- C++
- computer vision
- machine learning
- robotics
- Python
- ML
- multimodal vision
- visual foundation models
- video understanding
- embodied learning
- ML/DL
- PyTorch
- real sensors / temporal data / multi-sensor perception
- edge inference / model optimization
Preferred
- vision-language models / vision-language-action models / embodied AI
- multimodal
- edge deployment
Join Shield AI's Perception team as a Perception Engineer, where you'll turn cutting-edge AI research into practical applications for autonomous systems. You'll work alongside researchers and engineers to evaluate new approaches, build prototypes, and integrate successful ideas into the Hivemind product. This role requires a strong background in computer vision, machine learning, and robotics, as well as experience with Python and C++.
Responsibilities
- Evaluating promising approaches in multimodal computer vision and embodied AI, building prototypes, and integrating successful ideas into the Hivemind product.
- Combining learned methods with established perception techniques to improve detection, tracking, geometric vision, or sensor fusion.
- Optimizing and integrating capabilities for edge deployment, contributing Python and C++ software, and helping deliver tested, documented capabilities.
- A thoughtful approach to experiments, evaluation data, and understanding why models fail
Requirements
- Experience building substantial research software, an interest in developing production-quality C++, and a collaborative approach to solving problems
- Research depth in an area such as multimodal vision, visual foundation models, video understanding, open-vocabulary perception, or embodied learning
- A PhD in computer vision, machine learning (ML/DL), robotics, or a related field, or an equivalent record of advanced research and hands-on engineering
- Strong Python skills and experience with PyTorch or a comparable ML framework
- Experience with robotics, real sensors, temporal data, or multi-sensor perception
Experience bringing a research prototype into sustained use
- Experience with C++, edge inference, or model optimization using tools such as ONNX, TensorRT, or CUDA
- You don’t need to meet every preferred qualification or arrive as an expert C++ engineer. We welcome recent PhD graduates and early-career researchers, and we value technical depth, curiosity, and enthusiasm to transfer research to business value more than publication count alone
Preferred
- Familiarity with vision-language models, vision-language-action models, or embodied AI
Pay
USD 165,000 - 300,000
jobapplier