jobapplier

Data Engineer

tastytrade

Skills

Required

  • Airflow
  • Python
  • Snowflake / BigQuery / Redshift
  • data quality
  • Git / GitHub
  • design systems
  • Prefect / Dagster
  • data engineering
  • parsing
  • validation
  • version control
  • SQL

Preferred

  • Data quality frameworks
  • Carlo
  • Kubernetes / infrastructure-as-code

Join our Analytics team as a Data Engineer, where you'll own data pipeline architecture, upskill those around you, and have a real influence on how we build our data platform. You'll design systems, make tech decisions, ship, and iterate. This is a full-scope role that requires experience with Snowflake, dbt, Airflow, Tableau, Python, AWS, GitHub, ArgoCD, Elementary, and Grafana. You'll be responsible for designing and building scalable data pipelines, owning pipeline architecture and performance, and driving strategic initiatives to improve our data platform.

Responsibilities

  • Design and build scalable data pipelines using dbt, Python, Airflow, and Snowflake to support business processes.
  • Own pipeline architecture and performance, and drive strategic initiatives to improve our data platform.
  • Collaborate with upstream data producers (Software Engineering/DevOps) and downstream data consumers (Marketing, Product, and Leadership).

Requirements

You have hands-on experience with Airflow (or Prefect/Dagster)

  • You write solid Python, with production code rather than scripts
  • You have real dbt experience, meaning actual production work and not just exposure
  • You have 2-5 years of professional data engineering experience
  • You know your way around data quality functions like cleansing, standardization, parsing, and validation
  • You’re proficient with version control (Git/GitHub) and command line interfaces
  • You have expert SQL skills: you think in queries and optimize ruthlessly
  • You understand the data product lifecycle, standards, and practices
  • You have experience with a cloud data warehouse (Snowflake, BigQuery, or Redshift)
  • You can design systems and lead projects
  • You communicate clearly with non-engineers and engineers alike
  • Experience with agile development practices and the project lifecycle
  • Advanced Airflow patterns and custom operators
  • Financial services background
  • CI/CD and DevOps practices

Preferred

  • Data quality frameworks (Elementary, Great Expectations, Monte Carlo)
  • Kubernetes or infrastructure-as-code experience

Pay

USD 130,000 - 130,000