jobapplier

Senior Data Engineer

knowmad mood

Responsibilities

  • Design, develop, and optimize large-scale data pipelines using Apache Spark and Python/PySpark.
  • Create reliable, reusable, and well-structured datasets for business and analytical consumption.
  • Develop and maintain cloud-based data solutions on Microsoft Azure.
  • Process, transform, store, and expose data efficiently across different platforms and applications.
  • Implement data quality controls, validation processes, monitoring, and documentation standards across data pipelines.
  • Collaborate with Data Engineering, Data Science, Architecture, and business teams to understand requirements and deliver practical data solutions.
  • Contribute to engineering best practices related to code quality, testing, version control, CI/CD, and automation.
  • Apply data governance, data cataloging, and data quality monitoring practices to ensure trusted and compliant data assets.
  • Participate in the design of scalable cloud-based data architectures.

Preferred

  • Experience with Databricks, Delta Lake, Unity Catalog, and Databricks Workflows.
  • Hands-on experience delivering data engineering solutions using Azure Databricks.
  • Familiarity with data governance and data cataloging frameworks.

Professional Experience

5+ years of experience in Data Engineering. 5+ years of hands-on experience with Apache Spark using Python/PySpark in production environments. Proven experience building and maintaining production-grade data pipelines in large-scale or complex data ecosystems. Strong understanding of dimensional data modeling and data warehouse design principles. Experience designing scalable cloud-based data architectures. Ability to provide technical guidance and support on ETL/ELT best practices and data engineering standards.

Nice to Have

What do we offer? -Permanent contract -Remote work model 🏡. Option to go to the office, but always at the employee's choice. -Flexible hours ⏰: flexible schedule, start at 8:30 am, finish at 6 pm, with intensive Fridays from 8 am to 3 pm, and in summer (July and August) intensive from 8 am to 3 pm. -Vacation 🌴: 22 vacation days + 2 personal days, plus December 24th and 31st off. -Permanent contract 📄: from day one, with the option of 12 or 14 payments. -Flexible compensation 💳: Restaurant card, childcare voucher, health insurance, training, and other benefits with tax advantages. -Perks club 🎁: Discounts on technology, leisure, and training. -Continuous training 📚: Access to Udemy Business, language courses, official certifications, and technical training. -Career plan 🚀: Support to grow, specialize, or take on new challenges. -Overall well-being 💚: Nutrition programs, physical activity, and emotional balance. -Work-Life Balance +LIFE 👨 👩 👧 👦: 24/7 personal and family support. -Inclusive Environment 🌍: Diverse and multicultural setting. -Social Events 🎮: Activities to connect with the team. -Sign up and we’ll give you more details! 🚀 To stay updated on our news, follow us here -> knowmad mood At knowmad mood we are committed to equal opportunities and respect for diversity. We apply our Equality Plan and the principle of non-discrimination in all our selection processes.