FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and maintaining data pipelines in Azure using Databricks, with a strong focus on data quality, governance, and cloud migration. Proficient in implementing CI/CD practices and collaborating with cross-functional teams to deploy AI models effectively.
Highest-signal resume keywords
Azure Data ServicesDatabricksPySparkCI/CD PracticesPython and SQL
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentETL/ELTData ModelingData ProfilingData IntegrationCloud MigrationAI Model DeploymentAnalytical Data ModelingVersion ControlData Governance
Tools & Technologies
GitHubAzure MLDatabricks MLflowUnity Catalog
Industry Keywords
Medallion ArchitectureMaster Data ManagementData LakeData WarehouseFinancial Sector
Tech Stack
Tools & technologiesAzureCloudETLPySparkPythonSQLUnity
About the role
Key responsibilities & impact- Develop and maintain data pipelines (ETL/ELT) in an Azure environment, using Databricks for processing and integration
- Understand the project holistically and assess the impact of individual solutions
- Implement CI/CD practices to automate deployments and manage code versioning in GitHub
- Model and evolve tables in Unity Catalog, applying best practices for naming conventions and schema versioning
- Design and optimize data models to ensure scalability, performance, and governance
- Support cloud migration projects, ensuring data security, quality, and integrity
- Collaborate with business and data science teams to deploy AI models in a cloud environment
- Ensure data quality and consistency through data profiling and monitoring
- Document processes, architectures, and data engineering best practices
Requirements
What you’ll need- Strong experience with Azure Data Services and Databricks
- Experience using Databricks with PySpark
- Experience with the Medallion Architecture
- Proficiency in Python and SQL for data manipulation and transformation
- Knowledge of CI/CD and version control with GitHub
- Knowledge of analytical data modeling, including ingestion, preparation, and consumption layers
- Experience working on cloud migration projects
- Experience with ETL/ELT and the integration of large volumes of data
- Experience deploying AI models and using tools such as Azure ML
- Experience with AI projects and pipeline automation
- Preferred: knowledge of data-oriented architectures and data governance best practices
- Preferred: experience working on projects in the financial sector
- Preferred: participation in Master Data Management (MDM) initiatives
- Preferred: familiarity with Databricks MLflow for model management
- Preferred: experience working in Data Lake and Data Warehouse environments
Benefits
Comp & perks- Health and dental insurance
- Meal and food allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit Sharing and Results Sharing (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical and mental health and well-being
- Pregnancy and responsible parenting course
- Partnerships with online learning platforms
- Language learning platform
- Support and accommodations for people with disabilities throughout the recruitment process
- Assistance obtaining disability documentation
- Dedicated Health and Well-being team
- Inclusion specialists and affinity groups
