FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Azure Databricks, Spark, and Delta Lake for building scalable ELT pipelines and optimizing data platforms. Proven ability to mentor junior engineers and lead technical decisions while ensuring high data quality and governance.
Highest-signal resume keywords
Azure DatabricksData EngineeringPythonSQLCI/CD
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Azure DatabricksSparkDelta LakePythonSQLCI/CDDimensional ModellingDatabricks Asset BundlesJob OrchestrationData Quality Improvement
Soft Skills
MentoringTechnical CommunicationCollaboration
Tools & Technologies
Azure DevOpsGitHubUnity Catalog
Industry Keywords
Data Platform RoadmapELT PipelinesCore System MigrationStar SchemasMedallion Architecture
Tech Stack
Tools & technologiesAzurePythonSparkSQLUnity
About the role
Key responsibilities & impact- Own the Azure Databricks data platform roadmap and engineering standards
- Establish CI/CD, separate environments, automated testing, monitoring, and Unity Catalog access governance
- Design and lead robust, scalable ELT pipelines on Azure Databricks
- Lead the data workstream for the core lending platform migration
- Remap pipelines and models and reconcile outputs before and after cutover with Engineering
- Build and extend a curated dimensional data model for trusted, self-serve business data
- Improve data quality, freshness, and alerting
- Optimise clusters, job orchestration, and compute usage for platform cost efficiency
- Mentor and develop junior data engineers through code review, pairing, and clear standards
- Partner with analysts, data scientists, product managers, and Engineering to create trusted data products
Requirements
What you’ll need- 5+ years in data engineering
- Deep hands-on experience with Azure Databricks, Spark, Delta Lake, and Unity Catalog
- Strong Python and SQL skills
- Experience with CI/CD and deploying pipelines as code
- Experience with Azure DevOps or GitHub
- Experience with Databricks Asset Bundles
- Track record of improving standards on an existing platform
- Solid dimensional modelling experience, including star schemas, conformed dimensions, and medallion architecture
- Experience mentoring engineers and leading technical decisions through design and code review
- Ability to explain technical direction clearly to non-technical stakeholders
- Experience leading the data side of a core system migration is a strong plus
- Legal right to work in Australia or New Zealand without employer sponsorship
Benefits
Comp & perks- Hybrid working policy with state-based workplaces
- Up to 26 weeks paid parental leave
- Strategy Week twice a year
- Fortnightly all-company business updates
- Flat structure with learning opportunities from colleagues and senior leaders
- Wellbeing benefits supporting physical, psychological and financial wellbeing
- Birthday day off
- End-of-trip facilities