FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and maintaining scalable ETL/ELT pipelines using Azure Data Factory and Databricks, with a strong focus on data quality, governance, and integration for BI and AI/ML applications. Proficient in collaborating with cross-functional teams to deliver reliable data solutions and mentor junior engineers in best practices.
Highest-signal resume keywords
Azure Data FactoryDatabricksPythonPower BIData Governance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
ETL DevelopmentData Pipeline DesignSQLPySparkDelta LakeData Quality ChecksMonitoring and ObservabilitySemantic ModelingDimensional ModelingData Integration Patterns
Soft Skills
Clear CommunicationMentoringProblem-SolvingCollaborationContinuous Improvement Mindset
Tools & Technologies
Azure Data LakeMicrosoft FabricSAP S/4HANASAP DatasphereUnity Catalog
Industry Keywords
ManufacturingSupply ChainLife SciencesHealthcareRegulated Industry
Tech Stack
Tools & technologiesAzureCloudETLPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Design, build, and maintain scalable production ETL/ELT pipelines across Azure, Databricks, and SAP source systems
- Develop and optimize Databricks notebooks and jobs, Delta Lake tables, and Unity Catalog permissions for BI reporting and AI/ML workloads
- Integrate data from SAP S/4HANA, SAP Datasphere, and other enterprise applications into the lakehouse using Azure Data Factory, Microsoft Fabric, or equivalent orchestration tools
- Implement data-quality checks, monitoring, observability, and alerting
- Build and tune curated datasets and semantic models supporting Power BI reporting, standard KPIs, and single-source-of-truth dashboards
- Partner with data architects and senior engineers to define and implement enterprise data-integration patterns and reference architectures
- Write clean, tested, version-controlled code and participate in code reviews and CI/CD practices
- Troubleshoot production issues, participate in on-call or escalation rotations as needed, and document root causes and corrective actions
- Collaborate with analytics engineers and business teams within the Hub & Spoke model to understand data needs and promote reusable data-product standards
- Mentor junior data engineers on coding standards, pipeline design, troubleshooting, and platform conventions
- Stay current on Azure, Microsoft Fabric, Databricks, and the broader data-engineering landscape and provide practical recommendations
Requirements
What you’ll need- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field
- 8+ years of experience in data engineering, ETL/ELT development, or a related data-platform engineering role
- Hands-on experience building and operating pipelines in Azure Data Factory and Databricks using Python, PySpark and/or Spark SQL, including Delta Lake table design
- Experience designing and maintaining enterprise data pipelines in cloud environments, with attention to cost, performance, reliability, and scalability tradeoffs
- Experience supporting both BI and AI/ML data needs, including curated datasets for Power BI and feature pipelines for model training
- Preferred experience in manufacturing, supply chain, life sciences, healthcare, or another regulated industry
- Willingness to work overlapping hours with US and other global stakeholders as needed for cross-time-zone collaboration
- Strong SQL and Python skills
- Software-engineering practices in version control, testing, code review, and CI/CD
- Working knowledge of Azure data services, including Azure Data Lake, Azure Data Factory, Azure Databricks, and Microsoft Fabric or comparable cloud services
- Practical experience with SAP S/4HANA and SAP Datasphere data extraction is preferred
- Knowledge of Databricks or modern lakehouse platforms, Delta Lake, and Unity Catalog or similar access-control tooling
- Experience with Power BI, enterprise analytics, semantic models, dimensional modeling, star schemas, and data-integration patterns
- Working knowledge of data governance, data quality, monitoring, and observability practices
- Clear, proactive verbal and written communication
- Ability to operate in a Hub & Spoke or federated data organization
- Sound engineering judgment, a continuous-improvement mindset, and ability to deliver reliable pipelines in a fast-paced environment
Benefits
Comp & perks- Equal Opportunity/Affirmative Action Employer
- Opportunity to work with global stakeholders and teams
- Mentoring and professional development through collaboration with senior engineers and architects