Data Engineer

540

. Design, develop, and maintain scalable, production-ready data pipelines using Spark, Python, and SQL in a Databricks environment .

Posted 10/27/2026full-timeRemote • United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining scalable data pipelines using Python, SQL, and Apache Spark within a Databricks environment. Proficient in data modeling, API integrations, and implementing data governance practices to support enterprise reporting and decision-making.

Highest-signal resume keywords

Python ProficiencySQL ProficiencyApache Spark ExperienceDatabricks ExperienceData Pipeline Development

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringETL/ELT ProcessesData ModelingAPI IntegrationData ValidationQuality ChecksAutomated TestingGit-based DevelopmentCommand-line EnvironmentsAI-assisted Development Tools

Soft Skills

Strong Communication SkillsAbility to Navigate Ambiguity

Tools & Technologies

DatabricksAWS CloudGitLabCI/CD PipelinesPalantir Foundry

Certifications & Qualifications

DoW Secret Clearance

Industry Keywords

Data GovernanceData PrivacyData SecurityRegulated DataOperational Decision-making

Tech Stack

Tools & technologies

ApacheAWSCloudETLPythonSparkSQL

About the role

Key responsibilities & impact

Design, develop, and maintain scalable, production-ready data pipelines using Spark, Python, and SQL in a Databricks environment
Integrate and transform diverse health, financial, and operational datasets into reliable, reusable data products
Develop data models and analytics datasets supporting enterprise reporting and operational decision-making
Build and maintain API-based integrations for ingesting and exchanging data across systems
Monitor, troubleshoot, and optimize scheduled workflows and production pipelines for performance, reliability, and scalability
Implement data validation, quality checks, lineage, and governance practices
Contribute to automated testing, code reviews, technical documentation, and reusable engineering patterns
Collaborate with engineers, architects, analysts, and customer stakeholders to translate data needs into practical technical solutions

Requirements

What you’ll need

Remote within the continental United States; periodic travel may be required
U.S. Citizen with an active DoW Secret (or higher) clearance
3+ years of data engineering, software engineering, or related technical experience
Strong proficiency with Python and SQL
Experience with Apache Spark or similar distributed data-processing frameworks
Experience working with Databricks or a similar modern data platform
Experience building and maintaining production data pipelines and ETL/ELT processes
Working knowledge of data modeling and transforming raw data into reusable analytics datasets or data products
Experience integrating or consuming data through REST APIs
Experience troubleshooting and optimizing data pipelines for performance and reliability
Familiarity with data validation, quality, governance, security, privacy, and compliance considerations
Experience with Git-based development workflows and modern software engineering practices
Comfort working in terminal and command-line environments
Experience using AI-assisted development tools to accelerate routine engineering tasks, testing, documentation, and debugging
Strong communication skills and experience working with customers or stakeholders to understand and resolve data needs
Ability to navigate ambiguity, learn unfamiliar systems, and independently drive assigned work toward resolution
AWS cloud experience, experience with very large datasets, Palantir Foundry, Advana or similar DoW data environments, GitLab, CI/CD pipelines, automated deployment workflows, and regulated or sensitive data experience are nice to have

Benefits

Comp & perks

Flexible PTO + all Federal holidays off
Health, dental and vision insurance plans
Flexible Spending Account (FSA)
401k with employer match
Company-sponsored life insurance, short- and long-term disability
Professional development (training, certifications, conferences)
Paid cloud developer accounts
Referral bonuses
HQ office perks (parking / metro reimbursement, nitro coffee & lunches)
Annual social events (540 Week, hackathon, charity golf tournament, etc.)
Access to 540’s Washington Capitals & Nationals tickets