Lead Data Engineer

CreateFuture - Design & Innovation

. Own the technical direction of a data engagement .

Posted 9/29/2026full-timeRemote • United KingdomSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and evolving data platform architecture on Microsoft Fabric, with a strong focus on data pipelines and operational readiness. Proven ability to lead data engineering teams, enforce CI/CD practices, and translate business requirements into technical solutions.

Highest-signal resume keywords

Microsoft FabricData Platform ArchitectureSQL ExpertisePython and PySparkAzure DevOps

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data ModellingData EngineeringPipeline DesignTesting StandardsOperational Readiness

Soft Skills

Team LeadershipClient Stakeholder ManagementProblem Solving

Tools & Technologies

Azure OneLakeDatabricksSnowflakeAzure ML

Industry Keywords

CI/CDData VaultKimballMedallion PatternLakehouse Pattern

Tech Stack

Tools & technologies

AzureCloudPySparkPythonSQLVault

About the role

Key responsibilities & impact

Own the technical direction of a data engagement
Set standards for pipeline architecture, data modelling, testing, and operational readiness
Lead and technically direct a team of data engineers, allocating work, reviewing designs and code, and unblocking technical challenges
Design and evolve data platform architecture on Microsoft Fabric, including data pipelines, Azure OneLake, and the broader Azure ecosystem
Set and enforce CI/CD, testing, and operational practices using Azure DevOps
Build professional relationships with key client stakeholders and translate business and data requirements into a technical roadmap
Troubleshoot and resolve complex issues in live data pipelines
Lead incident response when issues occur
Collaborate with CreateFuture’s wider engineering capability to ensure technically excellent and commercially sound delivery

Requirements

What you’ll need

Extensive hands-on experience with a modern cloud data platform such as Microsoft Fabric, Databricks, Snowflake, or Synapse, including designing production data platforms
Deep SQL expertise and strong understanding of data modelling and architecture, including Kimball, data vault, medallion/lakehouse patterns, or domain modelling
Strong proficiency in Python and PySpark for batch/ELT data processing at scale
Experience leading or technically directing a team of data engineers
Experience setting standards for pipeline design, testing, and delivery
Experience owning CI/CD and operational practices for data engineering workflows, ideally using Azure DevOps
Experience working directly with client stakeholders
Familiarity with the broader Azure ecosystem, including Azure OneLake and Azure ML, particularly for model industrialisation

Benefits

Comp & perks

Flexible working, including hybrid and remote options
Supportive and friendly culture
Investment in professional and personal growth
Occasional travel to client sites or CreateFuture offices when needed
Clear, fair, and respectful hiring process
Application adjustments or support available
Great Place to Work-Certified™ company
Best Workplaces UK recognition