jobapplier

Senior Data Engineer

TripleLift

Skills

Required

  • ML
  • SQL
  • Python
  • Scala
  • Java
  • software engineering
  • cross-functional data modeling
  • database
  • OpenSearch
  • Druid
  • Clickhouse
  • InfluxDB

Preferred

  • containerization
  • K8s
  • ArgoCD
  • Spark
  • Kafka
  • AI operations and processes
  • MLFlow
  • Feast
  • Ray
  • AI training

Join TripleLift, a leading advertising technology company, as a Senior Data Engineer. In this role, you will be responsible for expanding and optimizing our data pipeline architecture, supporting the data needs of multiple teams, and building the infrastructure for optimal data extraction, transformation, and loading. You will work closely with stakeholders across different teams and have the opportunity to optimize and redesign our company's data architecture.

The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up

Responsibilities

  • Créer et maintenir une architecture de pipeline de données optimale, explorer et assembler de grands ensembles de données complexes.
  • Identifier, concevoir et mettre en œuvre des améliorations de processus internes, automatiser les processus manuels, optimiser la livraison des données.
  • Construire l'infrastructure requise pour l'extraction, la transformation et le chargement optimaux des données à partir d'une grande variété de sources de données.

Requirements

  • The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives
  • Strong command of SQL and expertise in one or familiarity with multiple of the following languages: Python, Scala, Java
  • Minimum of 5 years of professional software engineering experience, with a strong focus on data and ML processes running in production at scale

Proven track record of cross-functional data modeling

  • Understanding of a variety of database technologies such as OpenSearch, Druid, Clickhouse, InfluxDB, etc
  • Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience

Preferred

  • Experience in containerization, K8s and ArgoCD is a plus
  • Experience with optimizing big data and ML pipelines like Spark and Kafka at scale
  • Fundamental knowledge of ML and AI operations and processes. Experience in MLFlow, Feast, Ray, and other AI training technologies a plus