Data Engineer

Join Our Future Health, a groundbreaking initiative aimed at transforming the prevention, detection, and treatment of major health conditions. As a Data Engineer, you will play a crucial role in designing and building secure, high-quality data pipelines that power health research. You will work closely with engineering managers, lead data engineers, researchers, and domain experts to deliver impactful data products. This role offers the opportunity to work with valuable health datasets and make a real-world difference in healthcare.

Construire et maintenir des pipelines de données sur notre plateforme basée sur Azure, en traduisant les spécifications techniques en mises en œuvre sécurisées et évolutives.

We're looking for a Data Engineer who can take a design or architecture document, understand the intent behind it, and confidently build a secure, scalable solution

GBP 62,000 - 71,300

Responsibilities

• Développer des processus de transformation des données et d'ETL en utilisant Python et PySpark, et travailler avec des ensembles de données de santé pour créer des actifs de données fiables.
• Collaborer avec des chercheurs, des ingénieurs et des parties prenantes pour comprendre les exigences et livrer des solutions, tout en identifiant les risques et en améliorant les conceptions avant la mise en œuvre.
• Ability to review technical designs and architecture documents and translate them into practical implementations

Requirements

• You don't need experience with every tool in our stack
• Experience using Dagster or other workflow orchestration platforms
• Knowledge of healthcare coding systems and standards such as SNOMED CT, ICD, or READ codes
• Understanding of metadata management and data governance frameworks
• Understanding of cloud-based data platforms, ideally Azure
• Proven experience building production-grade data pipelines and ETL processes
• Excellent stakeholder management and communication skills
• SQL and data modelling experience
• Excellent Python skills with experience developing scalable data solutions
• Experience using GitHub and modern software engineering practices
• Experience conducting code reviews and maintaining engineering standards
• Experience with Databricks

Experience with Kubernetes

• Excellent problem-solving skills and an ability to challenge requirements constructively when needed
• If you're an engineer who enjoys solving complex data problems, questioning assumptions, and building secure systems that make a meaningful difference, we'd love to hear from you

Preferred

Experience working with NHS or healthcare datasets

• Experience working with sensitive or regulated data and knowledge of secure data handling principles
• Experience working with PySpark or distributed data processing frameworks