jobapplier

Senior Data Engineer

SpotHero

Skills

Required

  • Airflow
  • Kafka
  • Postgres
  • Spark
  • Python
  • Terraform
  • SQL
  • Docker
  • Kubernetes
  • S3
  • JVM
  • Kotlin
  • Java / Scala
  • MySQL
  • git

Preferred

  • cloud
  • data pipeline services
  • Hightouch
  • dbt

Join SpotHero, a fast-growing startup, as a Senior Data Engineer. In this role, you will focus on backend application development, building reusable infrastructure services, and influencing technology choices for data-heavy workloads. You will work closely with various teams to understand their data storage and processing needs, design and implement data platform solutions, and ensure system scalability. Enjoy a flexible PTO policy, annual parking stipend, and comprehensive benefits package.

Responsibilities

  • Contribuer à la conception et à la mise en œuvre de solutions de plateforme de données, de l'infrastructure à l'API.
  • Construire des pipelines robustes pour garantir que les données sont disponibles au bon moment et de manière évolutive.
  • Collaborer avec les équipes d'analyse, de science des données, de marketing et d'autres équipes pour comprendre leurs besoins en matière de stockage et de traitement des données.
  • Demonstrated experience designing and supporting technology intended to be used by other stakeholders

Requirements

  • You are able to design and implement high-quality software in Python
  • Strong ability to communicate on both business and technology subjects
  • You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)
  • We care about your abilities, not how you gained them. You might demonstrate the capabilities below through any combination of relevant professional experience, experience in a research setting, formal education, self-guided learning, open source contributions, or public speaking / writing / teaching experience
  • Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools

Experience using SQL to read and manage data

  • Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components
  • Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS
  • Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them
  • Experience using the latest AI tooling (Claude, Codex, etc.)
  • Redshift, Presto, or other MPP database experience
  • Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)
  • Postgres, MySQL, or other RDBMS experience
  • Message driven or streaming architectures, such as those with Kafka, Spark, Flink

Preferred

  • Experience with cloud data pipeline services like dbt Cloud, Airbyte, or Hightouch

Pay

USD 136,000 - 153,000