Senior Data Engineer

Join TripleLift, a leading advertising technology company, as a Senior Data Engineer. In this role, you will be responsible for expanding and optimizing our data pipeline architecture, ensuring optimal data delivery across multiple teams and projects. You will work closely with software engineers, product managers, business intelligence analysts, and data scientists to support their data infrastructure needs. The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a passion for optimizing data systems.

Responsibilities

• Créer et maintenir une architecture de pipeline de données optimale, explorer et assembler des ensembles de données complexes.
• Identifier, concevoir et mettre en œuvre des améliorations de processus internes, automatiser les processus manuels, optimiser la livraison des données.
• Construire l'infrastructure requise pour l'extraction, la transformation et le chargement optimaux des données à partir de diverses sources.

Requirements

Proven track record of cross-functional data modeling

• Experience with optimizing big data and ML pipelines like Spark and Kafka at scale
• Strong command of SQL and expertise in one or familiarity with multiple of the following languages: Python, Scala, Java
• Understanding of a variety of database technologies such as OpenSearch, Druid, Clickhouse, InfluxDB, etc
• Fundamental knowledge of ML and AI operations and processes. Experience in MLFlow, Feast, Ray, and other AI training technologies a plus
• Minimum of 5 years of professional software engineering experience, with a strong focus on data and ML processes running in production at scale
• Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience

Preferred

• Experience in containerization, K8s and ArgoCD is a plus

Pay

USD 130,000 - 170,000