Managing Consultant, Databricks Data Engineering Lead

Guidehouse

. Lead Databricks data engineering and DataOps delivery across ingestion, transformation, orchestration, migration, integration, serving, and consumption patterns.

Posted 11/3/2026full-timeUnited StatesSenior💰 $130,000 - $216,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Databricks data engineering, including the design and development of scalable data pipelines and frameworks. Proficient in leading technical delivery, mentoring teams, and ensuring adherence to coding and operational standards.

Highest-signal resume keywords

Databricks Data EngineeringApache SparkETL/ELTData Quality ControlsCI/CD

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringProduction Databricks SolutionsPythonSQLDelta LakeData MigrationAPI DevelopmentEvent-Driven PipelinesAutomated TestingData Transformation

Soft Skills

MentoringCommunicationCollaborationProblem-SolvingLeadership

Tools & Technologies

Azure DevOpsGitHub ActionsJenkinsTerraformUnity CatalogDelta Live TablesDatabricks WorkflowsAuto LoaderCloud StorageIdentity and Access Management

Certifications & Qualifications

Databricks Certified Data Engineer Professional

Industry Keywords

Federal Public TrustAgile ScrumKanbanPublic-Sector ModernizationEnterprise Data

Tech Stack

Tools & technologies

ApacheAzureCloudERPETLJenkinsPySparkPythonSparkSQLTerraformUnity

About the role

Key responsibilities & impact

Lead Databricks data engineering and DataOps delivery across ingestion, transformation, orchestration, migration, integration, serving, and consumption patterns.
Translate architecture, data models, mappings, data contracts, and migration requirements into scalable technical designs and delivery plans.
Design and develop reusable pipelines, migration utilities, transformation frameworks, data-quality controls, reconciliation routines, and governed data products.
Establish standards for coding, testing, CI/CD, deployment, observability, logging, error handling, performance, security, and operational support.
Lead engineering reviews and troubleshoot Databricks job failures, pipeline bottlenecks, data-quality issues, and performance problems.
Support batch and, where applicable, streaming data-processing patterns using Databricks, Apache Spark, and Delta Lake.
Coordinate technical delivery with data architects, source-system teams, integration engineers, security specialists, governance leads, testing teams, and business stakeholders.
Lead technical estimates, capacity planning, backlog refinement, sprint execution, release readiness, and stabilization activities.
Mentor data engineers and ensure reusable code, design patterns, runbooks, and lessons learned are adopted across later modernization waves.
Communicate technical decisions, risks, dependencies, and delivery impacts to client and program leadership.

Requirements

What you’ll need

Bachelor’s degree from an accredited universtiy.
Minimum SIX (6)+ years of experience.
Experience in data engineering, ETL/ELT, cloud data platforms, software development, or analytics engineering.
Hands-on experience designing and developing production Databricks solutions using Apache Spark, PySpark, Python, SQL, Delta Lake, notebooks, workflows, and jobs.
Experience building scalable batch data pipelines and reusable ingestion, transformation, and orchestration frameworks.
Experience with enterprise data migration, source-to-target mapping, data conversion, reconciliation, validation, and defect remediation.
Experience implementing data-quality controls, metadata capture, lineage, logging, monitoring, and technical auditability.
Experience with Git-based development, automated testing, CI/CD, release management, and production stabilization.
Experience leading data engineers and delivering complex data solutions in a client-facing environment.
Ability to obtain and maintain a Federal Public Trust.
Databricks Certified Data Engineer Professional or comparable Databricks certification.
Experience with Unity Catalog, Delta Live Tables, Databricks Workflows, Auto Loader, or related platform capabilities.
Experience with cloud storage, identity and access management, secrets management, networking, and platform security.
Experience with Azure DevOps, GitHub Actions, Jenkins, Terraform, or other infrastructure-as-code and deployment tools.
Experience developing APIs, data services, integration patterns, or event-driven pipelines.
Experience modernizing HR, ERP, workforce, financial, or other sensitive enterprise data.
Experience supporting federal agencies, regulated organizations, or public-sector modernization programs.
Experience with Agile Scrum or Kanban delivery.

Benefits

Comp & perks

Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Position may be eligible for a discretionary variable incentive bonus
Parental Leave and Adoption Assistance
401(k) Retirement Plan
Basic Life & Supplemental Life
Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
Short-Term & Long-Term Disability
Student Loan PayDown
Tuition Reimbursement, Personal Development & Learning Opportunities
Skills Development & Certifications
Employee Referral Program
Corporate Sponsored Events & Community Outreach
Emergency Back-Up Childcare Program
Mobility Stipend
Flexible benefits package
Travel up to 25%