Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Thought Logic Consulting

Managing Consultant, Databricks Engineer/Architect

Thought Logic Consulting

. Design and build scalable data engineering solutions using Databricks Lakehouse, including Delta Lake, Unity Catalog, Delta Live Tables/Lakeflow Declarative Pipelines, Delta Sharing, and Uniform (Iceberg) where appropriate .

Posted 9/17/2026full-timeBirmingham • Alabama • United StatesSeniorLeadWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and building scalable data engineering solutions using Databricks Lakehouse technologies, including Delta Lake and Apache Spark. Proficient in developing robust ETL/ELT processes and implementing data quality and governance practices across enterprise data platforms.

Highest-signal resume keywords
Databricks LakehouseApache SparkETL/ELT ProcessesData Quality GovernanceCI/CD Practices

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
DatabricksDelta LakeUnity CatalogLakeflowPySparkSQLPythonData EngineeringData PipelinesOrchestration Workflows
Soft Skills
Consulting SkillsCommunication SkillsProblem-Solving Skills
Tools & Technologies
AirflowDbtTerraformSnowflakeRedshiftBigQueryKafkaAmazon EMRDockerKubernetes
Certifications & Qualifications
Databricks Data Engineer AssociateDatabricks Data Engineer Professional
Industry Keywords
Data EngineeringData ArchitectureData GovernanceData QualityCloud Data Platforms

Tech Stack

Tools & technologies
AirflowAmazon RedshiftApacheBigQueryCloudDockerETLKafkaKubernetesPySparkPythonSparkSQLTerraformUnity

About the role

Key responsibilities & impact
  • Design and build scalable data engineering solutions using Databricks Lakehouse, including Delta Lake, Unity Catalog, Delta Live Tables/Lakeflow Declarative Pipelines, Delta Sharing, and Uniform (Iceberg) where appropriate
  • Develop and optimize batch, micro-batch, and streaming data pipelines using Auto Loader, Apache Spark, PySpark, SQL, and Python
  • Build robust ETL/ELT processes, data models, and orchestration workflows using Databricks Jobs/Workflows, Airflow, dbt, and modern data engineering patterns
  • Implement data quality, observability, governance, auditability, and performance optimization capabilities across enterprise data platforms
  • Establish modern CI/CD and DevOps practices for data engineering, including Databricks Asset Bundles, automated testing, deployment automation, and Infrastructure as Code with tools such as Terraform
  • Work alongside experienced architects and consultants while taking ownership of technical delivery
  • Develop client-facing and consulting skills
  • Collaborate with consultants, architects, engineers, and cross-functional stakeholders across technology, analytics, business operations, and leadership

Requirements

What you’ll need
  • 7+ years of data engineering/architecture, analytics, or related technical experience, including at least 2 years of hands-on Databricks and strong experience with Lakehouse technologies
  • Strong hands-on skills with Databricks, Delta Lake, Unity Catalog, Lakeflow/Delta Live Tables, Apache Spark, PySpark, SQL, and Python, including scalable batch and streaming pipelines
  • Experience with Databricks Workflows/Jobs, Auto Loader, Airflow, dbt, and/or similar orchestration and transformation technologies
  • Experience with cloud data platforms such as Snowflake, Redshift, or BigQuery
  • Understanding of enterprise data quality, governance, observability, auditability, performance optimization, CI/CD, and automated testing
  • Exposure to Databricks Asset Bundles and Terraform
  • Strong consulting, communication, and problem-solving skills
  • Ability to work directly with technical and non-technical stakeholders and translate business requirements into practical data solutions
  • Databricks Data Engineer Associate or Professional certification and multiple Databricks project delivery experiences are bonus qualifications
  • Experience with Kafka, Amazon EMR, Docker, Kubernetes, Great Expectations, Collibra, LangGraph, autonomous agents, GitHub Copilot, Claude Code, Cursor, Windsurf, Codex, or similar technologies is advantageous
  • Previous consulting or client-facing technical delivery experience, along with cloud or additional data engineering certifications, is advantageous
  • Candidates must currently reside in or live within a commutable distance to Birmingham, Alabama

Benefits

Comp & perks
  • Work on transformations that matter, not slide decks that sit on shelves
  • Real responsibility and ownership over how work gets delivered and how clients experience us
  • Direct access to firm leadership and influence over how we grow and evolve
  • A culture that values depth over optics, outcomes over activity, and people over process
  • The chance to grow your career in a firm that's scaling thoughtfully and intentionally, not just chasing growth for growth's sake
  • The opportunity to flex in a continuous learner environment. Get access and exposure to the latest tools, technologies and trends in the AI space