jobapplier

Data Engineer (Databricks + Fabric)

Nir Yu

Skills

Required

  • Databricks
  • Catalog
  • Microsoft Fabric in
  • Data Pipelines
  • Notebooks
  • Dataflows
  • SQL
  • Python
  • DP-900 / DP-700

Preferred

  • Fabric
  • ETL/ELT
  • Set up lakehouses
  • CI/CD
  • infrastructure as code

Responsibilities

  • Build and run production data platforms for our clients.
  • This is hands-on work, not an architect who only reviews.
  • Design and build ETL/ELT pipelines in Databricks and Fabric.
  • Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.
  • permissions, lineage and quality.
  • Automate deployments with CI/CD and infrastructure as code.
  • Gather requirements with the client and with other teams.
  • Spot improvements in the client's platforms that could turn into new projects.

Requirements

  • Hands-on Databricks in production.
  • PySpark, Delta Lake, Workflows and Unity Catalog (catalogs, permissions and lineage), with Medallion architecture.
  • Microsoft Fabric in production, across the full platform.
  • Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2 and Warehouse.
  • A proof of concept does not count.
  • Advanced SQL and Python.
  • A current DP-900 or DP-700 certification, with a commitment to earn the other one within the first 60 days.
  • Verify it with the Microsoft Learn link.
  • B2 or higher and fluent Spanish.