Lead Data Engineer

Redhorse Corporation

. Provide day-to-day task prioritization and technical direction to team members .

Posted 10/23/2026full-timeRemote • United StatesSenior💰 $170,000 - $190,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Expertise in architecting and optimizing data engineering workflows, with a strong focus on modular Python development and SQL optimization. Proven ability to lead technical teams, mentor engineers, and translate complex requirements into scalable data solutions.

Highest-signal resume keywords

Data EngineeringPython DevelopmentSQL OptimizationDatabricks ETL/ELT WorkflowsTechnical Mentorship

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonSQLDatabricksETL WorkflowsData ModelingCode ReviewData TransformationObject-Oriented ProgrammingData VisualizationPerformance Optimization

Soft Skills

Technical DirectionCommunicationMentoringTask PrioritizationCollaboration

Certifications & Qualifications

U.S. Government Secret Clearance

Industry Keywords

Data PlatformsData PipelinesEnterprise-Scale SolutionsTechnical SpecificationsData Integrity

Tech Stack

Tools & technologies

ETLPySparkPythonSQL

About the role

Key responsibilities & impact

Provide day-to-day task prioritization and technical direction to team members
Lead code reviews, ensure design best practices, and mentor engineers in modular Python development and SQL optimization
Elicit, refine, and translate complex mission requirements into technical specifications, interface designs, and scalable data models
Architect, develop, and optimize high-throughput ETL/ELT workflows using Databricks
Maintain, refactor, and enhance Python and SQL codebases for performance, stability, and security
Identify pipeline bottlenecks, debug complex data workflows, and implement automated solutions to improve pipeline reliability and data integrity
Partner with government product owners, data scientists, data analysts, and technical peers
Document architecture, coordinate technical sprints, and communicate engineering trade-offs to technical and non-technical audiences
Develop and maintain pipeline architecture documentation and configurations

Requirements

What you’ll need

Must be a U.S. Citizen
Must hold a current, active U.S. Government Secret clearance; applicants without an active Secret clearance cannot be considered
Minimum of 8+ years of professional experience in data engineering, building enterprise-scale data platforms and pipelines
Demonstrated experience providing technical mentorship, performing code reviews, and providing day-to-day technical task oversight to other engineers
Proven, hands-on experience designing and optimizing data transformation workflows in Databricks
Advanced skills in modular, object-oriented Python/PySpark scripting
Extensive experience writing, tuning, and optimizing complex SQL queries
Proven experience building functional, user-centric reports and dashboards using modern data visualization tools

Benefits

Comp & perks

Comprehensive benefits programs
Performance-based or other incentive compensation, where applicable
Reasonable accommodations for qualified individuals with disabilities or disabled veterans