FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building AI-enabled data platforms on AWS, developing data pipelines using Spark, Python, or SQL, and leading complex data engineering projects. Proficient in data governance, security principles, and managing multifunctional teams to deliver high-quality solutions.
Highest-signal resume keywords
AWS Data ServicesData Pipeline DevelopmentTeam ManagementData GovernanceSC Clearance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
SparkPythonSQLData LakesLakehousesData MeshesGenerative AILLM ApplicationsData Engineering DeliveryCloud-Native Products
Soft Skills
CollaborationCoachingMentoringStakeholder InfluenceRisk Anticipation
Tools & Technologies
AWS EMRDatabricksSnowflakeSageMakerPower BITableauQlikGitHub ActionsAzure DevOpsJenkins
Certifications & Qualifications
Active SC ClearanceBPSS Security Clearance
Industry Keywords
Data EngineeringAI/ML SolutionsData SecurityData GovernanceMatrix Organisation
Tech Stack
Tools & technologiesAWSAzureCloudJenkinsPythonSparkSQLTableauTerraform
About the role
Key responsibilities & impact- Deliver client-facing data engineering work across diverse projects
- Build modern AI-enabled data platforms on AWS
- Develop large distributed workloads, batch and streaming pipelines, and data foundations for machine learning, Generative AI and LLM solutions
- Collaborate with architects, technology consultants and public sector client stakeholders
- Lead multiple complex areas of data engineering delivery to time, cost and quality
- Manage teams and act as an escalation point for delivery decisions
- Productionise and operate data and AI/ML solutions
- Coach and mentor engineers and client counterparts
- Contribute to internal projects, training and development
- Drive innovation and market-leading engineering practices
- Anticipate project risks and coordinate multifunctional teams to resolve issues
Requirements
What you’ll need- Applicants must have been resident in the UK for the last five years
- Must not have spent more than six consecutive months outside the UK during that period
- Must hold active SC clearance
- Subject to satisfactory BPSS and SC security clearance
- Ability to work collaboratively in a matrix organisation
- Ability to build data platforms using cloud-native products or commercial data analytics/data warehouse software
- Experience leading complex data engineering delivery to time, cost and quality with minimal direction
- Experience inclusively managing teams and acting as a key escalation point
- Experience building data pipelines using Spark, Python or SQL
- Experience with AWS data and AI/ML services such as SageMaker
- Experience with AWS big data and lakehouse platforms, including EMR, Databricks or Snowflake
- Experience building Data Lakes, Lakehouses or Data Meshes
- Understanding of Data Security, Data Governance and responsible AI principles
- Ability to influence senior stakeholders and build trust
- Experience anticipating project risks and forming multifunctional SME teams
- Subject matter expertise across multiple clients and industries
- Experience productionising and operating data and AI/ML solutions, including Generative AI or LLM applications
- Experience coaching and mentoring engineers
- Desirable: automated data quality checks and metrics
- Desirable: CI/CD tools such as GitHub Actions, Azure DevOps, Jenkins or CircleCI
- Desirable: LLM/foundation-model applications, LangChain, vector databases or agentic AI
- Desirable: MLOps and Infrastructure as Code using Terraform or CloudFormation
- Desirable: Power BI, Tableau or Qlik
- Desirable: AI or agentic techniques using GitHub Copilot, Claude Code or equivalent
Benefits
Comp & perks- Comprehensive benefit plan
- Personalised development opportunities
- Training and development
- Rapid progression opportunities for high performers
- Social team connections and regular team activities
- Flexible hybrid working model