FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and optimizing scalable data pipelines and models within the Databricks platform, with strong proficiency in AWS, Python, and SQL. Capable of leading data engineering initiatives, mentoring teams, and ensuring data quality and governance.
Highest-signal resume keywords
DatabricksAmazon Web Services (AWS)PythonSQLData Engineering
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignData ModellingDatabase DesignData WarehousingData QualityData GovernanceReal-Time Data ProcessingData ExtractionData TransformationData Aggregation
Soft Skills
Problem-SolvingAttention to DetailAdaptabilityInitiativeCollaboration
Tools & Technologies
DatabricksAWSSpark
Certifications & Qualifications
Basic DBS Check
Industry Keywords
Energy SectorData MigrationData-Rich Environment
Tech Stack
Tools & technologiesAWSCloudPythonSparkSQL
About the role
Key responsibilities & impact- Design, build and optimise scalable, high-performing data pipelines and data models within the Databricks platform
- Integrate new data sources using batch and streaming/real-time approaches
- Design and improve data quality, reliability and observability processes
- Own complex engineering problems and develop robust, pragmatic solutions aligned to business needs and architectural principles
- Lead data engineering activity within delivery teams and provide technical direction
- Engage with senior data stakeholders to understand requirements and influence technical decisions
- Contribute to the design and evolution of the data platform
- Recommend improvements to architecture, pipeline design and engineering approaches
- Develop and maintain documentation across data pipelines and associated systems
- Embed security, governance and operational standards
- Collaborate across multi-skilled, cross-functional teams and with external partners
- Contribute technical opinions and experience to engineering discussions
- Coach, mentor and support other Data Engineers
- Promote engineering excellence, peer review and continuous improvement
- Work independently with autonomy and accountability to deliver high-quality solutions
Requirements
What you’ll need- At least 5 years' experience as a Data Engineer or in a similar data-focused role
- At least 1 year working as a Senior Data Engineer
- Strong experience with Amazon Web Services (AWS)
- Strong experience with Databricks and/or Spark
- Strong Python and SQL skills, including production-quality code
- Solid understanding of cloud-based data engineering design, particularly within AWS
- Experience designing and delivering data extraction, transformation and aggregation solutions, including large-scale and real-time data where applicable
- Strong understanding of data modelling, database design and data warehousing concepts
- Experience designing repeatable, production-quality data pipelines using parameterisation, reusable patterns and engineering best practice
- Understanding of data governance, data quality and data cataloguing principles and associated tools
- Experience translating stakeholder requirements into effective technical solutions
- Ability to take ownership of complex data engineering problems and deliver robust solutions aligned to business needs
- Strong problem-solving skills, including structured troubleshooting and root cause analysis
- Strong attention to detail and curiosity about data
- Confidence and adaptability to learn new tools and technologies
- Ability to set goals, take initiative and work with a high degree of autonomy
- Basic DBS check required for successful candidates
- Previous experience with data migration projects would be advantageous
- Experience coaching or mentoring other Data Engineers would be advantageous
- Experience with streaming or real-time data at scale would be advantageous
- Experience within the energy sector or another complex, data-rich environment would be advantageous
Benefits
Comp & perks- Competitive salary
- 26 days of annual leave plus bank holidays
- Generous pension
- Life cover
- Bonus opportunities
- Access to 20 flexible benefits with tax/NI savings
- Excellent parental leave allowance
- Hybrid and family-friendly policies
- Fertility Friendly and Menopause Friendly support
- Disability Confident Employer support and workplace adjustments
- Inclusive talent networks
- Top-tier development programmes
- Basic DBS check arranged via a third-party service provider for successful candidates