FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Data Engineer
Expleo Group. Design and develop robust ETL/ELT pipelines using PySpark and SQL for large-scale data processing .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and developing ETL/ELT pipelines using PySpark and SQL, with a strong focus on data quality, governance, and collaboration with analytics and ML teams. Proficient in managing data workflows on Databricks and optimizing performance across cloud platforms.
Highest-signal resume keywords
PySparkSQLDatabricksAWSAzure
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
ETLELTData ProcessingQuery OptimisationWindow FunctionsCTEsComplex JoinsData GovernanceData QualityFeature Engineering
Soft Skills
CollaborationTroubleshootingDocumentation
Tools & Technologies
Databricks NotebooksDelta LakeUnity CatalogApache KafkaSpark Streaming
Industry Keywords
Data EngineeringCloud PlatformsData WorkflowsML Pipelines
Tech Stack
Tools & technologiesApacheAWSAzureCloudETLKafkaPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Design and develop robust ETL/ELT pipelines using PySpark and SQL for large-scale data processing
- Build, manage, and optimise data workflows on Databricks, including notebooks, jobs, and cluster configurations
- Collaborate with analytics and ML teams to deliver clean, well-documented datasets
- Monitor pipeline performance, troubleshoot failures, and ensure data quality and integrity
- Define and implement data governance and best practices across the data platform
- Participate in design reviews and contribute to architectural decisions
Requirements
What you’ll need- 4–6 years of hands-on experience in data engineering or a related role
- Strong proficiency in PySpark for large-scale distributed data processing
- Advanced SQL skills, including query optimisation, window functions, CTEs, and complex joins
- Solid experience with Databricks, including Delta Lake and workflows; Unity Catalog preferred
- Experience working with cloud platforms (AWS/Azure)
- Core skills: PySpark, SQL, Databricks, AWS, Azure, Python, Git
- Experience with streaming frameworks such as Apache Kafka or Spark Streaming is nice to have
- Exposure to ML pipelines and feature engineering workflows is nice to have