FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and optimizing scalable data pipelines using Azure Databricks and Azure Data Factory, with a strong focus on ETL/ELT processes and data modeling for BI and Analytics. Proficient in leveraging PySpark, SQL, and Python to ensure data quality and performance across various data architectures.
Highest-signal resume keywords
Azure DatabricksPySpark / Apache SparkAzure Data FactoryData ModelingCI/CD
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
ETLELTSQLPythonData LakehouseDelta LakeData GovernanceStreamingSpark Structured StreamingDimensional Modeling
Soft Skills
Analytical MindsetSolution-OrientedCollaboration
Tools & Technologies
Azure PipelinesAzure DevOpsGitBitbucketErwinGitHub CopilotDatabricks Assistant
Certifications & Qualifications
Azure (DP-203)Databricks Certifications
Industry Keywords
Medallion ArchitectureData TransformationData ModernizationData QualityData Catalog
Tech Stack
Tools & technologiesApacheAzureCloudETLOraclePySparkPythonSparkSQL
About the role
Key responsibilities & impact- Design, develop, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory
- Develop ETL/ELT processes, from data ingestion through transformation and delivery
- Work with the Medallion Architecture (Bronze, Silver, and Gold) and Data Lakehouse solutions
- Develop solutions using PySpark, Spark SQL, SQL, and Python
- Work with Delta Lake, ensuring data quality, consistency, performance, and reliability
- Develop and optimize data models for BI and Analytics consumption
- Integrate different data sources and systems, including relational databases and APIs
- Partner with BI, Data Science, Engineering, and Business teams
- Apply best practices for quality, governance, version control, and CI/CD
- Use generative AI tools and coding assistants to increase productivity and development quality
- Investigate issues, propose improvements, and turn business needs into robust, scalable, and reliable data solutions
- Contribute to global data transformation and modernization projects using Cloud, Data, and Artificial Intelligence technologies
Requirements
What you’ll need- Solid experience as a Data Engineer in production environments
- Strong experience with Azure Databricks
- Advanced knowledge of PySpark / Apache Spark, including the processing and optimization of large volumes of data
- Advanced SQL skills
- Experience with Python applied to Data Engineering
- Experience with Azure Data Factory (ADF) for building and orchestrating pipelines
- Knowledge of ETL/ELT and Medallion Architecture (Bronze, Silver, and Gold)
- Experience with Delta Lake and Data Lakehouse
- Knowledge of data modeling, especially dimensional and relational modeling
- Experience with Git and version control workflows, preferably using Bitbucket
- Knowledge of CI/CD, Azure Pipelines, Azure DevOps, or similar tools
- Experience working with relational databases such as SQL Server and/or Oracle
- Hands-on, analytical, and solution-oriented mindset
- Ability to independently investigate issues and propose improvements
- Ability to collaborate effectively with different teams and business areas
- Experience with Kimball methodology and multidimensional models is a plus
- Knowledge of Azure Purview or other Data Governance/Data Catalog tools is a plus
- Experience with Azure DevOps applied to data pipelines is a plus
- Knowledge of Streaming, Spark Structured Streaming, or Azure Event Hubs is a plus
- Experience with data modeling tools such as Erwin or similar is a plus
- Experience with GitHub Copilot, Databricks Assistant, or other AI tools applied to software development is a plus
- Azure (DP-203) or Databricks certifications are a plus
Benefits
Comp & perks- Health and dental insurance
- Meal and food allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit-Sharing and Results Program (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical and mental health and well-being
- Pregnancy and responsible parenthood course
- Partnerships with online course platforms
- Language learning platform
- Support and accommodations for people with disabilities
- Dedicated Health and Well-being team, inclusion specialists, and affinity groups
- Global projects, continuous learning, innovation, and professional growth