Machine Learning Engineer, Computer Vision (NXJ-218)
Newxel
- Warsaw, Poland
- Hybrid
- Mid Level
- 3+ years
- Posted
Skills
Required
- computer vision
- video
- GPU
- ML
- Python
- PyTorch
- TensorRT
- ONNX Runtime
- OCR
- temporal localisation
- mAP
- IoU
- FFmpeg
- Docker
Preferred
- A/B testing
- Azure
- Service Bus
- Blob
- Storage
- sports video
- message-driven architectures
- vision-language models
- multimodal
The video understanding pipeline—from multi-object tracking and re-identification to action recognition—is yours to own and scale. The technical challenge lies in balancing high-throughput, low-latency GPU inference with cutting-edge detection accuracy across massive streams of sports footage. You will establish rigorous benchmark suites and decide which vision foundation models make it into production.
Responsibilities
- The platform ingests live and recorded sports video to automatically extract real-time metadata, temporal key moments, player statistics, and scene-boundary events. Operating across multiple sports leagues, it relies on frame-accurate video parsing to power downstream broadcast automation, search, and analytics tooling.
- The core ML pipeline is built in Python using PyTorch for model training and fine-tuning. Production GPU inference is optimized for cost and latency using TensorRT and ONNX Runtime within Dockerized, queue-driven microservices. FFmpeg handles large-scale video decoding, while Azure (Service Bus, Blob Storage) underpins the asynchronous messaging infrastructure.
Own and improve the vision services
- Own the video understanding pipeline, including object detection, multi-object tracking, player re-identification, jersey-number recognition and on-screen text recognition (OCR).
- Own event and action recognition, including temporal localisation of key moments, shot and scene-boundary detection, replay detection and camera-view classification.
- Optimise GPU inference for throughput and cost through batching, precision tuning and compilation.
- Monitor production quality and latency, and investigate failures and regressions.
Evaluate and test new models
- Build and maintain labelled sports benchmarks, split by sport, league and content type.
- Define and track key metrics, including mAP, F1, precision, recall, IoU, latency and GPU cost.
- Run systematic bake-offs comparing new detection, tracking, segmentation, re-identification and video foundation models. Reproduce published results on our data.
- Write decision memos with clear recommendations, trade-offs and licensing considerations.
- Own the regression suite and shadow or A/B testing pipelines, ensuring every model or configuration change is validated before deployment.
- Track new papers, model releases and leaderboards, and identify which developments warrant further evaluation.
Requirements
- 3–5+ years of experience shipping production ML systems, including 2+ years in computer vision, ideally working with video.
- Strong Python and PyTorch skills, including hands-on experience profiling and optimising GPU inference using TensorRT and ONNX Runtime.
- Hands-on experience in at least two of the following areas: object detection and segmentation (YOLO, DETR-family, SAM), OCR and scene-text recognition, or video action recognition and temporal localisation.
- Experience building test sets, calculating evaluation metrics such as mAP, F1 and temporal IoU, and running rigorous model comparisons.
- Ability to critically evaluate new research papers and model cards, and reproduce published results.
- Production deployment experience with Docker, queue-driven services and cloud GPU infrastructure.
- Experience with video processing at scale, including FFmpeg, video decoding pipelines and frame sampling.
- Strong written communication skills, with the ability to document technical trade-offs and make clear recommendations.
Preferred
- Experience with Azure (Service Bus, Blob Storage) and message-driven architectures.
- Experience with vision-language models and multimodal understanding across video, audio and text.
- Experience fine-tuning or adapting vision models to specific domains, particularly sports video.
- Experience with self-supervised learning or synthetic data generation to reduce labelling costs.
- Familiarity with annotation tools such as CVAT and Label Studio, and experience working with labelling teams.
- Experience with shadow deployments and A/B testing.
- Familiarity with commercial model licensing.
Why This Role Is Worth Your Time
- Direct, unconstrained ownership of the full ML lifecycle—from paper replication and benchmark creation to live GPU optimization.
- Production impact at scale, where your model optimization directly lowers real-world infrastructure costs and improves latency on high-volume video data.
- High-rigor, evidence-driven engineering environment that prioritizes A/B testing, shadow paths, and statistical validation over hype.
