Principal Software Engineer (Data Infrastructure)

Join our team as a Principal Software Engineer (Data Infrastructure) and take ownership of the technical architecture and development of our platform frameworks and infrastructure. In this role, you will define the technical vision for a declarative, configuration-driven ingestion framework, build scalable platform frameworks, set infrastructure and deployment standards, drive platform reliability and observability, lead evidence-based technology decisions, drive cross-functional platform delivery, and raise engineering standards. You will have the opportunity to work in a hybrid work model, enjoy generous benefits, and make a significant impact on our engineering effectiveness across teams.

You have deep experience applying AI tools to complex engineering work, including architecture exploration, development, testing, and problem-solving. You help shape how AI is incorporated into engineering workflows while maintaining strong judgment around security, accuracy, maintainability, and where human oversight remains essential

Responsibilities

• Définir la vision technique et l'architecture d'un cadre d'ingestion déclaratif et piloté par la configuration.
• Diriger la conception et la mise en œuvre de bibliothèques réutilisables et versionnées qui soutiennent la protection des données.
• Établir des pratiques d'infrastructure-as-code pour un déploiement, un remplacement, un retour en arrière et une gestion du cycle de vie sûrs.
• Excellent written and verbal communication skills, including the ability to develop clear technical designs, architecture decision records, interface contracts, and documentation while influencing senior stakeholders without direct authority
• Experience designing and operating large-scale data systems processing billions of rows, including performance testing, cost optimization, monitoring, and recovery strategies
• You navigate ambiguous technical challenges, evaluate tradeoffs thoughtfully, and take ownership of delivering durable solutions that improve engineering effectiveness across teams
• Deep hands-on expertise with Databricks, including Delta Lake, Unity Catalog, Auto Loader, workflows, compute configuration, and governance capabilities, or equivalent data platform experience

Requirements

• Bachelor's degree or higher, or equivalent combination of education and experience
• Deep experience building ingestion capabilities across diverse data sources, including relational databases, files, APIs, and custom systems, with expertise in incremental processing, change data capture (CDC), schema evolution, and protecting production source systems from excessive load
• Strong experience with infrastructure as code, including Terraform and CI/CD pipelines for data platforms
• 10+ years of software or data platform engineering experience, including designing and delivering platform-level frameworks, libraries, or infrastructure used across multiple engineering teams
• Strong knowledge of security and privacy engineering for sensitive data, including encryption, key management, tokenization or format-preserving techniques, role-based access controls, and audit logging
• Advanced programming skills in Python, SQL, and a JVM language such as Scala or Java, with experience developing Spark UDFs and reusable libraries using strong testing, packaging, and versioning practices
• Experience in banking, lending, or another regulated environment with model risk management, SOX, or similar audit requirements

Preferred

• Experience with data quality, lineage, catalog tooling, and data contract approaches
• Prior experience as a Principal Engineer, Staff Engineer, or technical lead for a platform engineering team
• Experience with Databricks Asset Bundles or equivalent deployment tooling

Pay

USD 197,000 - 230,000