FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and operating scalable data pipelines using Microsoft Fabric, with strong programming skills in Python and SQL. Proficient in data integration, ETL/ELT development, and implementing data quality and security measures.
Highest-signal resume keywords
Microsoft FabricData EngineeringPython ProgrammingETL/ELT DevelopmentCI/CD Practices
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignData IntegrationPySparkSpark SQLT-SQLData ModelingData ArchitectureBatch ProcessingDelta Lake ConceptsPerformance Optimization
Soft Skills
CommunicationCross-Functional CollaborationOwnership
Tools & Technologies
OneLakeData FactoryAzure DevOpsGitHub ActionsPower Query
Industry Keywords
Data QualityObservabilityMetadataLineageTestingException Handling
Tech Stack
Tools & technologiesApacheAzureCloudETLPySparkPythonSparkSQL
About the role
Key responsibilities & impact- Design, build, and operate scalable batch and near-real-time data pipelines in Microsoft Fabric
- Create and maintain Lakehouse and Warehouse solutions in OneLake
- Develop data ingestion, cleansing, transformation, and integration logic using Python, PySpark, Spark SQL, T-SQL, and Power Query
- Integrate structured, semi-structured, and unstructured data from cloud, on-premises, SaaS, API, file, and streaming sources
- Optimize data pipelines and analytical workloads for performance, reliability, maintainability, and efficient Fabric capacity consumption
- Implement engineering standards for data quality, observability, metadata, lineage, security, testing, exception handling, and operational support
- Work closely with Data Scientists, BI Developers, Analysts, Architects, and business stakeholders to translate data requirements into reusable, analytics-ready solutions
- Contribute to CI/CD, source control, automated deployment, environment management, and release practices for Fabric workspaces and data products
- Evaluate new Microsoft Fabric capabilities and recommend pragmatic improvements to the data platform and delivery approach
- Share expertise with team members and maintain clear technical documentation, runbooks, standards, and best practices
Requirements
What you’ll need- 5+ years of hands-on experience in Data Engineering, including the design and delivery of large-scale data pipelines and cloud data platforms
- Strong practical experience with Microsoft Fabric, including Lakehouse, OneLake, Data Factory pipelines, notebooks, Apache Spark, and Fabric Warehouse
- Advanced programming skills in Python and SQL, with hands-on experience in PySpark or Spark SQL for distributed data processing
- Strong background in data integration, ETL/ELT development, data modeling, data architecture, and analytics-oriented solution design
- Experience designing reliable batch-processing solutions and integrating data from multiple enterprise source systems
- Understanding of Delta Lake concepts, partitioning, schema evolution, incremental loading, and performance optimization
- Experience implementing security, access control, data-quality checks, monitoring, logging, testing, and production support for data solutions
- Experience with Git-based development and CI/CD practices using Azure DevOps, GitHub Actions, or comparable tooling
- Ability to communicate technical decisions clearly, work effectively with cross-functional teams, and take ownership from design through production
Benefits
Comp & perks- Training programs
- Free language courses
- Competence centers
- Active tech community
- Hybrid work
- Workation
- Flexible hours
- Parental support
- Sabbaticals
- Sustainability Hub
- Diverse communities
- Diversity Taskforce
- After-work activities
- Public transport tickets
- Job bikes
- Exclusive Volkswagen employee conditions when leasing or purchasing a vehicle
- Health offers
- Supplementary insurances
- Pension plan
- Various discounts