FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates extensive expertise in architecting and delivering enterprise data solutions using Azure Databricks and Lakehouse platforms, with a strong focus on governance, performance, and cost management. Proven ability to lead technical teams, mentor professionals, and connect architectural decisions to business outcomes.
Highest-signal resume keywords
Azure Databricks ExpertiseEnterprise Data ArchitectureSenior Technical LeadershipApache Spark ProficiencyDatabricks Certified Data Engineer Professional
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Azure DatabricksApache SparkPySparkPythonSQLDelta LakeETL/ELTData ModelingPerformance TuningData Quality
Soft Skills
Collaborative LeadershipExecutive-Level CommunicationBusiness AcumenMentoringProblem-Solving
Tools & Technologies
Microsoft AzureMicrosoft Entra IDAzure Storage/ADLSAzure NetworkingGitGitHubAzure DevOpsTerraformAzure MonitorPower BI
Certifications & Qualifications
Databricks Certified Data Engineer ProfessionalAzure Platform Architect BadgeDatabricks Data + AI Platform AdministratorDatabricks Certified Generative AI Engineer AssociateMachine Learning Professional
Industry Keywords
Enterprise DataAnalytics ConsultingInsurance IndustryCloud TransformationData Warehouse Migration
Tech Stack
Tools & technologiesApacheAzureCloudETLPySparkPythonSparkSQLTerraformUnityVault
About the role
Key responsibilities & impact- Own technical vision, target-state architecture, principles, standards, and roadmaps for complex Azure Databricks engagements
- Lead discovery and architecture workshops, translating business priorities, security needs, operational constraints, and success measures into solution designs
- Architect secure and scalable enterprise Lakehouse platforms covering ingestion, storage, transformation, orchestration, analytics, data sharing, and AI/ML enablement
- Establish engineering, governance, identity, networking, CI/CD, observability, reliability, performance, and cost-optimization standards
- Provide delivery oversight by reviewing implementation artifacts, identifying risks, guiding technical decisions, and aligning sold and delivered solutions
- Support qualification, solution shaping, estimates, staffing plans, proposals, statements of work, demonstrations, and executive presentations
- Develop reference architectures, accelerators, assessment methods, estimation models, delivery playbooks, and thought leadership
- Mentor architects, engineers, and consultants
- Partner with Databricks, Microsoft, customer stakeholders, sales teams, and internal practices
- Serve as senior technical authority for enterprise data-platform engagements from discovery through production delivery
Requirements
What you’ll need- 10+ years of experience in enterprise data and analytics consulting
- 5+ years architecting and delivering production Databricks or Lakehouse solutions
- 3+ years in senior technical leadership, solution architecture, or principal-level consulting roles
- 3+ years in an insurance firm in a consulting capacity
- Experience as the senior technical authority for complex enterprise data-platform engagements from discovery through production delivery
- Deep Azure Databricks expertise across platform architecture, data engineering, Unity Catalog governance, operationalization, performance, and cost management
- Strong command of Apache Spark, PySpark, Python, SQL, Delta Lake, batch and streaming patterns, ETL/ELT, data modeling, data quality, performance tuning, and production troubleshooting
- Working knowledge of Microsoft Entra ID, Azure networking and private connectivity, ADLS, secrets and key management, monitoring, and related Azure data services
- Experience with Git-based development, automated testing, CI/CD, environment promotion, infrastructure as code, deployment automation, observability, runbooks, and support models
- Strong consulting and business acumen connecting architecture decisions to customer outcomes, delivery risk, scope, margin, adoption, and platform consumption
- Executive-level written, verbal, facilitation, and presentation skills
- Experience in discovery, estimation, staffing, proposal or SOW development, technical pre-sales, delivery leadership, and multidisciplinary team guidance
- Self-directed, collaborative leadership with sound judgment, resilience, empathy, and ability to create structure in ambiguous situations
- Databricks Certified Data Engineer Professional strongly preferred
- Azure Platform Architect Badge and/or Databricks Data + AI Platform Administrator accreditation preferred
- Databricks Partner Champion or Delivery Expert recognition, partner or Center of Excellence leadership, co-sell experience, or work in regulated and security-sensitive industries preferred
- Willingness to complete an OZ-approved, role-aligned certification or accreditation path after joining if lacking an appropriate Databricks credential
- Databricks Certified Generative AI Engineer Associate or Machine Learning Professional is a plus
- Experience with large-scale platform modernization, cloud transformation, data-warehouse migration, or consolidation involving Databricks preferred
- Experience creating reusable offerings, accelerators, reference architectures, assessment frameworks, delivery playbooks, or intellectual property preferred
- Experience overseeing production analytics, machine-learning, or AI workloads beyond proof-of-concept delivery preferred
- Experience with Azure Databricks, Delta Lake, Unity Catalog, Databricks SQL, Lakeflow Jobs and pipelines, Apache Spark, PySpark, Python, SQL, Microsoft Azure, Microsoft Entra ID, Azure Storage/ADLS, Azure networking, Private Link, Key Vault, Azure Monitor, Git, GitHub and/or Azure DevOps, automated testing, CI/CD, Terraform or comparable infrastructure as code, Databricks CLI and APIs, and Declarative Automation Bundles
- Exposure to MLflow, model serving, Power BI, Microsoft Fabric, Azure Data Factory, and Microsoft Purview preferred
Benefits
Comp & perks- Competitive Pay
- 401K
- Health Coverage
- Unlimited PTO
- Flexible work arrangements, including hybrid and/or remote work
- Tools and support to thrive
- Collaboration, growth, and work-life balance culture