FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Engineer
Advancing Analytics. Support the rollout and maintenance of a large, multi-service Data and AI platform .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and maintaining data and AI platform solutions using Microsoft Azure, Apache Spark, and Python. Proficient in ETL methodologies, data governance, and agile project management, with strong client consulting and requirements gathering skills.
Highest-signal resume keywords
Data EngineeringMicrosoft AzureApache SparkPython ProficiencyETL Approaches
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data EngineeringPythonSQLETL ApproachesAgile Project ManagementObject-Oriented DevelopmentCI/CD MethodologiesInfrastructure-As-CodeData GovernanceCloud Computing
Soft Skills
Client ConsultingRequirements GatheringCollaborationCommunicationTeam Engagement
Tools & Technologies
Azure Data FactoryAzure Data Lake StorageDelta LakeDatabricksTerraformAzure DevOpsUnity CatalogPurviewStreaming DataDistributed Compute
Industry Keywords
Data QualityResilienceObservabilityAgileSDLC
Tech Stack
Tools & technologiesApacheAzureCloudETLPythonSDLCSparkSQLTerraformUnity
About the role
Key responsibilities & impact- Support the rollout and maintenance of a large, multi-service Data and AI platform
- Build solutions using the core data engineering technology stack
- Develop end-to-end data and AI platform solutions
- Gather requirements and consult with clients
- Contribute to agile projects
- Apply ETL approaches focused on data quality, resilience, and observability
- Work with distributed compute, streaming data, visualization, Azure Functions, and related technologies where applicable
- Collaborate within an inclusive team and engage with the wider technology community
Requirements
What you’ll need- Experienced Data Engineer
- Based within the UK
- Experience with Microsoft Azure and cloud computing concepts
- Experience with Apache Spark, including Databricks, Microsoft Fabric, or another Spark engine
- Proficiency in Python
- Proficiency in SQL, including complex high-performance queries and query execution across compute technologies
- Experience with Azure Data Factory or other cloud orchestration tools
- Experience with Azure Data Lake Storage and Delta Lake
- Experience with Unity Catalog, Purview, or other data governance tools
- Experience with infrastructure-as-code tools such as Terraform or Azure DevOps
- Requirements gathering and client consulting skills
- Agile project management knowledge
- Understanding of object-oriented development practices
- Knowledge of ETL approaches, including data quality, resilience, and observability
- Understanding of CI/CD methodologies and SDLC
Benefits
Comp & perks- Access to the latest technology and training opportunities through Microsoft Specialised Partner, Databricks Elite Partner, and AWS Partner status
- Investment in employees’ long-term goals
- Collaborative and inclusive team environment
- Zero-burnout culture
- Professional development through meetups, conferences, events, speaking, mentoring, and sponsorship
- Equal opportunity workplace