Data Engineer, Databricks

Cogent People

. Build and maintain data pipelines for a mission-critical, data-centric system supporting a large-scale Federal Government IT healthcare program .

Posted 11/6/2026full-timeColumbia • Maryland • United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and maintaining data pipelines using Databricks, Python, and PySpark, while ensuring compliance with federal security standards. Proficient in data governance, Agile methodologies, and DevSecOps practices to deliver high-quality data solutions.

Highest-signal resume keywords

Databricks Pipeline DevelopmentPython ProgrammingData GovernanceAgile MethodologiesPublic Trust Clearance

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringSQLPySparkDelta LakeDatabricks WorkflowsOracle SQLPL/SQLCI/CDSpark Performance TuningData Security Best Practices

Soft Skills

Strong CommunicationTeamwork

Tools & Technologies

DatabricksAWS S3AWS IAMAWS GlueAWS LambdaUnity Catalog

Certifications & Qualifications

Databricks Certified Data Engineer

Industry Keywords

Federal GovernmentHealthcareDevSecOpsAgileRegulated Environments

Tech Stack

Tools & technologies

AWSOraclePySparkPythonSparkSQLUnity

About the role

Key responsibilities & impact

Build and maintain data pipelines for a mission-critical, data-centric system supporting a large-scale Federal Government IT healthcare program
Translate business requirements into working pipelines aligned with architecture and security boundaries
Build, test, and maintain Databricks pipelines using Python, PySpark, and Spark SQL
Design Delta Lake tables and ingestion patterns for batch loads and recurring reports
Convert Oracle SQL and PL/SQL logic to Databricks and validate results against the source system
Automate recurring reports on Databricks
Schedule, monitor, and tune Databricks Workflows for performance, cost, and availability
Administer Databricks workspaces, including compute and cluster policies, users, groups, service principals, permissions, and secrets
Apply data governance and access controls using Unity Catalog within federal security boundaries
Follow DevSecOps practices using Git, CI/CD pipelines, and environment promotion
Collaborate with developers, project managers, business analysts, and testers in an Agile team
Document solutions and work produced

Requirements

What you’ll need

Must have lived in the U.S. for at least 3 of the past 5 years
Must be authorized to work in the U.S. as a Citizen, Permanent Resident, or EAD holder
This position does not offer sponsorship; candidates must already be authorized to work in the U.S.
Public Trust Clearance or ability to obtain
Bachelor’s degree in computer science, software engineering, data engineering, or related field, or equivalent experience
5+ years of hands-on data engineering experience
At least 2 years building production pipelines on Databricks
Strong Python and PySpark
Strong SQL
Experience with Delta Lake, Databricks Workflows/Jobs, and Databricks notebooks or Repos
Basic Databricks administration, including clusters, SQL warehouses, cluster policies, users, groups, service principals, permissions, Unity Catalog grants, secret scopes, and usage/cost monitoring
Experience with AWS data services, including S3, IAM, Glue, or Lambda
Good understanding of software development processes
Experience with Agile methodologies; Scrum required, SAFe a plus
Working knowledge of DevSecOps practices, including CI/CD and release management
Ability to apply data security best practices, Spark performance tuning at scale, and system availability practices
Strong communication and teamwork skills
Preferred: Oracle database background, data modeling, query tuning, indexing, and partitioning
Preferred: Oracle PL/SQL development, including stored procedures, packages, and functions
Preferred: Experience migrating Oracle databases or PL/SQL logic to Databricks or Spark
Preferred: Databricks Certified Data Engineer certification
Preferred: Experience in regulated or government environments, especially healthcare
Preferred: Understanding of AI/ML principles or exposure to Databricks ML workflows such as MLflow
Preferred: Experience with analytical and BI tools

Benefits

Comp & perks

Health, Dental, and Vision Insurance: Comprehensive coverage
401(k) Plan: Matching contributions
Company-paid life insurance
Company-paid short-term disability insurance
Company-paid long-term disability insurance
3 weeks of PTO annually
10 holidays
Career development opportunities
Collaborative, growth-driven environment
Supportive, inclusive culture
Competitive salaries
Meaningful projects with mission-critical technology solutions