FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and maintaining scalable data pipelines, integrating diverse data sources, and implementing data governance strategies. Proficient in utilizing cloud platforms and ETL tools to enhance data accessibility and quality for analysis.
Highest-signal resume keywords
Python ProgrammingData Pipeline DevelopmentETL ProcessesAzure Data FactorySQL Data Modeling
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonPySparkSASSQLData ModelingETLELTHadoopHiveSpark Optimization
Soft Skills
Stakeholder Management
Tools & Technologies
AzureAzure DevOpsDatabricksDelta LakePower BIDockerCI/CDKubernetesTerraformOctopus
Certifications & Qualifications
Cloud/Data Engineering Certification
Industry Keywords
Data GovernanceAgile EnvironmentCloud MigrationBusiness IntelligenceData Quality
Tech Stack
Tools & technologiesAzureCloudDockerETLHadoopInformaticaKubernetesPySparkPythonSparkSQLTerraform
About the role
Key responsibilities & impact- Develop and maintain scalable data pipelines
- Build new API integrations to support increasing data volume and complexity
- Integrate offline and online data to improve understanding of customer behavior and journeys for personalization
- Collect, parse, manage, analyze, and visualize large datasets
- Cleanse data and improve data quality and readiness for analysis
- Define and implement data governance strategies and enforce best practices across platforms
- Transform and cleanse data into appropriate storage structures for querying and analysis using ETL and ELT processes
- Ensure data is accessible and usable across the enterprise
- Enable deeper and more timely understanding of operations
Requirements
What you’ll need- Master's/Bachelor's degree in Engineering, Computer Science, Mathematics, Statistics, or equivalent
- Bachelor's degree or equivalent in Computer Science, MIS, Mathematics, Statistics, or similar discipline
- 4–7 years of relevant work experience
- Strong programming skills in Python, PySpark, and SAS
- Experience with large datasets and Hadoop, Hive, distributed computing systems, and Spark optimization
- Experience with cloud platforms, preferably Azure
- Experience with Azure Data Factory, ADLS Storage, Azure DevOps, Databricks, Delta Lake, and Workflows
- Knowledge of DevOps processes and Docker, CI/CD, Kubernetes, Terraform, and Octopus
- Hands-on experience with SQL and data modeling
- Proficiency with enterprise data pipeline and ETL tools such as Ab Initio, Informatica, DataStage, or equivalent
- Experience working in an Agile environment
- Fluency in English
- Master's degree or PhD preferred
- Experience with stakeholder management is an added advantage
- Cloud migration experience, BI tools such as Power BI, and cloud/data engineering certification are good to have
Benefits
Comp & perks- Career mobility and development opportunities
- Opportunities for advancement and location transfer
- Training and leadership programs
- Competitive benefits
- Flexible work arrangements
- Programs supporting employee well-being
- Equal opportunities, fairness and respect
- Reasonable accommodation for physical and mental disabilities