FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building ETL/ELT pipelines using Python and SQL, optimizing Spark/PySpark jobs, and managing Airflow DAGs. Proficient in designing Lakehouse architectures and implementing data quality frameworks within a multi-cloud data platform.
Highest-signal resume keywords
Python ProficiencyAdvanced SQL SkillsAirflow ManagementSpark/PySpark OptimizationCI/CD Pipeline Development
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
ETL/ELT Pipeline DevelopmentData Quality FrameworksDimensional ModelingLakehouse Architecture DesignValidation Framework ImplementationObservability PracticesStreaming TechnologiesData ContractsSchema EvolutionMulti-Cloud Data Platforms
Tools & Technologies
AirflowSparkPySparkDbtS3AthenaRedshiftTerraformKubernetesDocker
Industry Keywords
Data EngineeringCI/CDData Catalog ManagementMetadata ManagementStreaming Platforms
Tech Stack
Tools & technologiesAirflowAmazon RedshiftCloudDockerETLKafkaKubernetesPySparkPythonSparkSQLTerraform
About the role
Key responsibilities & impact- Build ETL/ELT pipelines using Python and SQL
- Optimize Spark/PySpark jobs
- Manage Airflow DAGs
- Implement dbt transformations
- Design medallion-style Lakehouse architectures using S3 and modern table formats such as Iceberg and Delta Lake
- Create reusable frameworks and enforce data contracts
- Build CI/CD pipelines
- Establish observability practices
- Implement validation frameworks, data contracts, and SLIs/SLOs for critical pipelines
- Work within an agile team to modernize a multi-cloud data platform
- Leverage streaming technologies and automation/AI to improve efficiency
Requirements
What you’ll need- 5+ years in data engineering
- Strong Python, advanced SQL, Airflow, Spark/PySpark, dbt, and CI/CD proficiency
- Experience with Lakehouse architectures, dimensional modeling, and cloud data warehouses (S3, Athena, Redshift)
- Data quality frameworks, monitoring, and schema evolution expertise
- Experience with streaming platforms (Kafka, Kinesis) is a plus
- Experience with AI coding assistants (Cursor, Claude Code, Copilot) is a plus
- Terraform, Kubernetes/Docker is a plus
- Data catalog/metadata management experience is a plus