Lead Data Engineer
- London, United Kingdom
- Lead/Staff
- 15+ years
- Posted
Skills
Required
- cloud
- software engineering
- data architectures
- Snowflake
- Data governance
- data engineering / migrations
- metrics
- ELT
- Data warehouse modelling
- SQL
- PL/SQL
- Python
Preferred
- Informatica
- PowerCenter
- Cloud data lake
- data warehouse solutions
- Oracle
- Snowflake-based
- Enterprise scale data modelling
Join LCH, a leading clearing house, as a Lead Data Engineer. You will be responsible for setting the technical direction of the Reporting & Data Analytics platform, delivering features, and ensuring ongoing stability during and after the transformation to a cloud-native architecture. You will lead a team of engineers, design and build solutions, and ensure the platform evolves into a scalable, governed platform that supports our members, clients, and internal partners.
Lead the technical direction and delivery of the Reporting & Data Analytics platform, ensuring alignment with engineering principles and best practices.
About London Stock Exchange
- Immutable, incremental and versioned data architectures
- Experience of modern observability platforms e.g. DataDog
Responsibilities
- Oversee the migration from legacy Oracle/Informatica platforms to a cloud-native, Snowflake-based data platform, taking accountability for successful legacy decommissioning.
- Act as a senior technical partner to Group Architecture Authority, Group Data Governance, and Product and business partners, influencing group-level architecture and governance bodies.
- Seniority and credibility to influence group level architecture and governance bodies
- Enterprise scale data modelling
- Quality-first approach
Requirements
- Practical and relevant AI experience in data engineering / migrations use cases
- 15+ years of hands-on software engineering experience, including at least 5+ years as a technical lead, with consistent track record of delivering high-quality solutions
- Passionate about metrics driven approach and leading with data
- ELT data architectures, using dbt or similar
- Strong engineering background with the ability to engage deeply in design and implementation
- Data warehouse modelling approaches
- Solid experience of data-centric solution using SQL, PL/SQL and Python
- Deep expertise in
- Shown leadership of enterprise scale Snowflake (or similar) data platform implementations
- Detail oriented problem solver, comfortable “diving-deep”
- Data governance, lineage and control frameworks
Degree in Computer Science, Software Engineering or equivalent
- Knowledge and practical experience running technology both on prem and in cloud
- Experience of large-scale real-time and batch process orchestration, optionally with third-party orchestration engines
- Good understanding of cyber security standards and practices and follows secure-by-design principle
- Experience of working with agile frameworks like Scrum, Kanban
Preferred
- Prior experience working with Informatica PowerCenter or similar solutions
- Cloud data lake and data warehouse solutions
- Experience operating in regulated, high availability environments
- Background working in financial industry
