Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Oddball

Lead Data Engineer

Oddball

. Set the technical approach for migrating data and pipelines onto the lakehouse .

Posted 11/6/2026full-timeRemote • United StatesSenior💰 $110,000 - $145,000 per yearWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in data engineering leadership, particularly in migrating data and pipelines to cloud environments using Azure Data Factory and Databricks. Proven ability to mentor engineers, ensure data quality, and collaborate effectively in Agile settings.

Highest-signal resume keywords
Data Engineering LeadershipAzure Data FactoryDatabricksSQLPython

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Data MigrationETLData WarehouseData ReconciliationLakehouse ArchitectureMedallion ArchitectureDeltaPerformance OptimizationCloud ComputingAgile Methodologies
Soft Skills
MentoringCommunicationCollaborationProblem SolvingLeadership
Tools & Technologies
Azure DatabricksAzure Data FactorySQLPython
Industry Keywords
Federal Data EnvironmentsRegulated DataBackground InvestigationSecurity Clearance

Tech Stack

Tools & technologies
AzureCloudETLPythonSparkSQL

About the role

Key responsibilities & impact
  • Set the technical approach for migrating data and pipelines onto the lakehouse
  • Guide migration teams on patterns, reconciliation, and quality gates
  • Design reusable migration pipelines using Azure Data Factory and Azure Databricks
  • Define source and target data reconciliation methods to confirm accuracy
  • Resolve complex pipeline and performance problems
  • Mentor data engineers and review their work
  • Partner with product, QA, and platform teams
  • Perform other related duties as assigned

Requirements

What you’ll need
  • Data engineering leadership on large migration or modernization programs
  • Deep experience with Databricks or Spark and Azure Data Factory
  • Strong SQL and Python skills
  • Experience moving legacy ETL and data warehouse workloads to the cloud
  • Understanding of lakehouse and medallion architecture, including Delta
  • Experience in federal or regulated data environments is a plus
  • Ability to thrive in a remote, collaborative Agile environment
  • Ability and genuine interest in leading and mentoring engineers
  • Clear and open communication skills
  • Applicants must be authorized to work in the United States
  • Certain roles may require U.S. citizenship and the ability to obtain and maintain a federal background investigation and/or security clearance
  • Bachelor's Degree

Benefits

Comp & perks
  • Fully remote
  • Tech & Education Stipend
  • Comprehensive Benefits Package
  • Company Match 401(k) plan
  • Flexible PTO
  • Paid Holidays