FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates extensive expertise in Azure Databricks architecture and enterprise data solutions, with a strong focus on governance, performance optimization, and scalable lakehouse platforms. Proven ability to lead technical teams, mentor professionals, and connect architectural decisions to business outcomes.
Highest-signal resume keywords
Azure Databricks ExpertiseEnterprise Data ArchitectureApache Spark ProficiencyCI/CD ImplementationDatabricks Certified Data Engineer Professional
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Azure DatabricksApache SparkPySparkPythonSQLDelta LakeETL/ELTData ModelingPerformance TuningData Quality
Soft Skills
Executive-Level CommunicationCollaborative LeadershipBusiness AcumenMentoringFacilitation Skills
Tools & Technologies
Microsoft AzureMicrosoft Entra IDAzure Storage/ADLSAzure MonitorGitGitHubAzure DevOpsTerraformMLflowPower BI
Certifications & Qualifications
Databricks Certified Data Engineer ProfessionalAzure Platform Architect BadgeDatabricks Data + AI Platform Administrator
Industry Keywords
Data EngineeringCloud TransformationData-Warehouse MigrationAI/ML WorkloadsGovernance
Tech Stack
Tools & technologiesApacheAzureCloudETLPySparkPythonSparkSQLTerraformUnityVault
About the role
Key responsibilities & impact- Own the technical vision, target-state architecture, principles, standards, and roadmaps for complex Azure Databricks engagements
- Lead discovery and architecture workshops, translating business priorities, security needs, operational constraints, and success measures into solution designs
- Architect secure and scalable enterprise lakehouse platforms covering ingestion, storage, transformation, orchestration, analytics, data sharing, and AI/ML enablement
- Establish engineering, governance, identity, networking, CI/CD, observability, reliability, performance, and cost-optimization practices
- Provide delivery oversight by reviewing critical implementation artifacts, identifying risks, guiding technical decisions, and aligning sold and delivered solutions
- Support qualification, solution shaping, estimates, staffing plans, proposals, statements of work, demonstrations, and executive presentations
- Develop reusable reference architectures, accelerators, assessment methods, estimation models, delivery playbooks, and thought leadership
- Mentor architects, engineers, and consultants
- Partner with Databricks, Microsoft, customer stakeholders, sales teams, and internal practices
Requirements
What you’ll need- 10+ years of experience in enterprise data and analytics consulting
- 5+ years architecting and delivering production Databricks or Lakehouse solutions
- 3+ years in senior technical leadership, solution architecture, or principal-level consulting roles
- Experience as the senior technical authority for complex enterprise data-platform engagements from discovery through production delivery
- Deep Azure Databricks expertise across platform architecture, data engineering, Unity Catalog governance, operationalization, performance, and cost management
- Strong command of Apache Spark, PySpark, Python, SQL, Delta Lake, batch and streaming patterns, ETL/ELT, data modeling, data quality, performance tuning, and production troubleshooting
- Working knowledge of Microsoft Entra ID, Azure networking and private connectivity, ADLS, secrets and key management, monitoring, and related Azure data services
- Experience with Databricks Partner Champion or Delivery Expert recognition, partner or Center of Excellence leadership, co-sell experience, or regulated and security-sensitive industries
- Experience with Git-based development, automated testing, CI/CD, environment promotion, infrastructure as code, deployment automation, observability, runbooks, and support models
- Strong consulting and business acumen connecting architecture decisions to customer outcomes, delivery risk, scope, margin, adoption, and platform consumption
- Executive-level written, verbal, facilitation, and presentation skills
- Experience in discovery, estimation, staffing, proposal or SOW development, technical pre-sales, delivery leadership, and multidisciplinary team guidance
- Self-directed and collaborative leadership style with sound judgment, resilience, empathy, and ability to create structure in ambiguous situations
- Databricks Certified Data Engineer Professional strongly preferred
- Azure Platform Architect Badge and/or Databricks Data + AI Platform Administrator accreditation preferred
- Willingness to complete an OZ-approved, role-aligned certification or accreditation path after joining if lacking an appropriate Databricks credential
- Experience with large-scale platform modernization, cloud transformation, data-warehouse migration, or consolidation involving Databricks preferred
- Experience creating reusable offerings, accelerators, reference architectures, assessment frameworks, delivery playbooks, or intellectual property preferred
- Experience overseeing production analytics, machine-learning, or AI workloads beyond proof-of-concept delivery preferred
- Proficiency with Azure Databricks, Delta Lake, Unity Catalog, Databricks SQL, Lakeflow Jobs and pipelines, Apache Spark, PySpark, Python, SQL, Microsoft Azure, Microsoft Entra ID, Azure Storage/ADLS, Azure networking, Private Link, Key Vault, Azure Monitor, Git, GitHub and/or Azure DevOps, automated testing, CI/CD, Terraform or comparable infrastructure as code, Databricks CLI and APIs, and Declarative Automation Bundles
- Exposure to MLflow, model serving, Power BI, Microsoft Fabric, Azure Data Factory, and Microsoft Purview preferred
Benefits
Comp & perks- Competitive Pay
- 401K
- Health Coverage
- Unlimited PTO
- Flexible work arrangements, including hybrid and/or remote work
- Tools and support to thrive
- Culture of collaboration, growth, and balance