Data Engineer

Join our remote-first company as a Data Engineer. You will play a central role in building infrastructure to ingest, transform, and load data from various sources. You will also develop an entity resolution framework, CI/CD pipelines, and solutions to undefined data engineering and data science problems. Enjoy unlimited PTO, monthly employee stipends, and comprehensive medical, dental, and vision insurance.

Responsibilities

• Construire une infrastructure pour ingérer, transformer et charger un volume de données en constante augmentation à partir de diverses sources.
• Développer un cadre de résolution d'entités organiques capable de fusionner correctement des milliards d'entités individuelles en ensembles de données propres et exploitables.
• Développer des pipelines CI/CD et des systèmes de détection d'anomalies pour améliorer continuellement la qualité des données mises en production.
• Ability to scope and break down projects and communicate progress and blockers effectively with managers, teammates, and stakeholders

Requirements

• Experience working with entity data (entity resolution or record linkage)
• Ability to balance high ownership and autonomy with strong collaboration

Strong software development fundamentals

• Understanding of modern data storage formats and tools, such as Parquet, ORC, Avro, and Delta Lake
• Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering
• Ability to work effectively remotely, proactively managing blockers, asking questions, and participating in team activities
• 3–5+ years of industry experience, with clear examples of strategic technical problem-solving and implementation
• Experience building scalable data processing systems (e.g., cleaning and transformation) from the ground up
• Experience writing data design documents, including pipeline design, dataflow, and schema design

Expertise with Apache Spark (Java, Scala, and/or Python-based)

• Expertise with Python and the Python data stack, such as NumPy and pandas
• Experience using developer-oriented data pipeline and workflow orchestration tools (e.g., Airflow, dbt, Dagster, or similar)
• Experience working with data acquisition or data integration
• Experience with streaming platforms such as Kafka
• Strong written communication skills in Slack/chat and documents

Experience with SQL

• Experience with data warehousing, such as Databricks, Snowflake, Redshift, or BigQuery
• Experience evaluating data quality and maintaining high data standards across new feature releases, including consistency, accuracy, validity, and completeness
• Knowledge of modern data design and storage patterns, such as incremental updating, partitioning and segmentation, rebuilds, and backfills
• Experience working in Databricks, including Delta Live Tables and data lakehouse patterns
• Experience with Python
• Experience with cloud computing services such as AWS, GCP, or Azure

Pay

USD 180,000 - 220,000