Senior Software Developer (Cloud Platform)
BlueCat
- Toronto, Canada
- Senior Level
- Posted
Join our team as a Senior Software Developer (Cloud Platform) and play a key role in building and operating our data lake on a ClickHouse-centered architecture. You will develop and maintain data pipelines, implement data analytics jobs and APIs, and partner with application teams to understand requirements and recommend data design approaches. You will also improve the performance, scalability, reliability, and cost efficiency of data services, implement data protection and security controls, and build with modern programming languages.
Responsibilities
- Construire et exploiter notre lac de données sur une architecture centrée sur ClickHouse, y compris les pipelines d'ingestion, la modélisation des données, la partition et la réplication.
- Développer et maintenir des pipelines de données et des services déclenchés par des événements qui déplacent des messages et des données à travers la plateforme.
- Mettre en œuvre des travaux d'analyse de données et des API qui exposent des données aux équipes de produits et d'applications.
- Experience with cloud-native technologies: Kubernetes, containers, CI/CD, and observability
Requirements
- Understanding of networking fundamentals (TCP/IP, DNS, HTTP/S) and distributed systems design
- Experience with data lake architectures and open file and table formats such as Parquet and Apache Iceberg (Delta Lake is a plus), on object storage
Strong communication and teamwork skills
- 5+ years of software engineering experience, with 3+ years building data platforms or data-intensive distributed systems
- Passion for building solid REST APIs and distributed services
- Experience with data processing and analytics tools such as Pandas, Polars, DuckDB, or equivalents (Dask, Ray, Prefect are a plus)
- Experience building data pipelines on messaging and streaming systems (Kafka, RabbitMQ, Redis, or similar)
- Strong production experience with Python (including async programming) and/or Golang
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience
- Experience with AWS (GCP and Azure are a plus)
- Working knowledge of the SDLC, Agile, testing strategies, and secure engineering practices
Preferred
- Highly desirable: Kubernetes certification (CKAD or CKA)
- Hands-on experience with ClickHouse or a comparable OLAP database or query engine (DuckDB, Druid, Pinot, Trino, or similar). This includes data modeling, ingestion, and query performance tuning
jobapplier