Databricks Solution Architect

Clearstead

. Lead the architecture and development of the Azure Databricks platform, including Delta Lake, Unity Catalog, and medallion architecture .

Posted 10/31/2026full-timeRemote • United StatesSeniorLead💰 $170,000 - $215,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Azure Databricks architecture and development, including Delta Lake and Unity Catalog, while managing production data pipelines and ensuring data quality and security. Proven ability to collaborate with cross-functional teams and translate technical requirements into effective business solutions.

Highest-signal resume keywords

Azure DatabricksData EngineeringPySparkSQLData Architecture

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data PipelinesData IntegrationAutomated TestingInfrastructure ManagementData TransformationReconciliation ProcessesQuality AssuranceCost OptimizationAI ApplicationsAdvanced Analytics

Soft Skills

Strong CommunicationCollaborationMentoringAttention to DetailPrioritization

Tools & Technologies

Unity CatalogDelta LakeSalesforceTerraformCI/CD PracticesPower BIDatabricks AI/BI GenieDelta Sharing

Certifications & Qualifications

Certified Data Management Professional (CDMP)Databricks Data Engineer AssociateDatabricks Data Engineer Professional

Industry Keywords

Financial ServicesWealth ManagementRegulated Data EnvironmentsEnterprise Data PlatformsExternal Technology Partners

Tech Stack

Tools & technologies

AzureCloudPySparkSQLTerraformUnity

About the role

Key responsibilities & impact

Lead the architecture and development of the Azure Databricks platform, including Delta Lake, Unity Catalog, and medallion architecture
Establish technical standards, security controls, and scalable data integration frameworks
Oversee platform performance, monitoring, operational readiness, and cost optimization
Manage the transition of platform ownership from external implementation partners
Design, build, and maintain production data pipelines using PySpark, SQL, and Databricks Workflows
Integrate information from Salesforce, Orion, Addepar, PARis, and other enterprise systems
Develop data transformation, reconciliation, and quality assurance processes
Implement automated testing, deployment, and infrastructure management practices
Develop data infrastructure supporting AI applications, intelligent agents, and advanced analytics
Support document ingestion, vector search, model serving, and retrieval-augmented generation
Collaborate with the AI Engineer and Data Management Lead to deliver secure, scalable solutions
Serve as the technical design authority for the enterprise data platform
Evaluate vendor solutions and oversee implementation partner deliverables
Partner with business and technology leaders to translate requirements into effective solutions
Mentor developing engineers and promote engineering best practices
Design, implement, and maintain a secure, scalable, and high-performing Databricks platform
Develop and optimize production data pipelines, ensuring data accuracy, system reliability, cost management, and timely resolution of technical issues
Establish architecture standards, guide implementation partners, and collaborate with cross-functional teams to deliver solutions aligned with business objectives and regulatory requirements

Requirements

What you’ll need

Bachelor's degree in Data, Information Systems, Computer Science, Business Analytics, or a related field, or equivalent combination of education and relevant professional experience
10+ years of experience in data engineering, data architecture, or related disciplines
4+ years designing and managing production Databricks environments
Expert knowledge of Azure Databricks, Unity Catalog, Delta Lake, and data architecture principles
Strong hands-on experience with PySpark, SQL, data pipelines, and data integration
Experience supporting AI or machine learning workloads within Databricks
Knowledge of Azure security, identity management, Terraform, and CI/CD practices
Demonstrated experience managing enterprise data platforms and external technology partners
Strong communication skills with the ability to translate technical concepts for business stakeholders
Advanced degree in Information Systems, Data Analytics, or a related discipline preferred
Certified Data Management Professional (CDMP), Databricks Data Engineer Associate or Professional, or comparable industry certifications preferred
Databricks Data Engineer Professional certification and additional platform administration or architecture credentials preferred
Experience with financial services, wealth management, or regulated data environments preferred
Familiarity with Salesforce Financial Services Cloud, Orion, or Addepar preferred
Experience with Power BI, Databricks AI/BI Genie, and Delta Sharing preferred
Ability to perform sitting and keyboarding duties
Attention, analysis, prioritization, interaction, and collaboration abilities
Occasional flexibility in work hours may be required

Benefits

Comp & perks

Fully remote work environment
Limited to no travel
Home-based work environment
Potential flexibility in work hours for system implementations, production incidents, or critical business operations