Data Engineer, Databricks

Peraton

. Build out and configure a dedicated Government workspace within the existing Databricks environment .

Posted 9/17/2026full-timeRemote • United StatesMid-LevelSenior💰 $112,000 - $179,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and configuring data ingestion pipelines within Databricks, with a strong focus on data governance, compliance, and integration of enterprise systems. Proficient in utilizing PySpark, Spark SQL, and Python for large-scale data processing and pipeline development.

Highest-signal resume keywords

Databricks Platform ExperiencePySpark ProficiencyUnity Catalog AdministrationPipeline Orchestration ToolsData Governance Principles

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Ingestion PipelinesPySparkSpark SQLPythonUnity CatalogDelta LakeSchema EvolutionTime TravelGitCI-CD Pipeline

Tools & Technologies

DatabricksAirflowAzureAWS

Certifications & Qualifications

DoD 8570 Certification

Industry Keywords

CUIPIIPHIFinancial DataHR DataCRM DataITSM DataCompliance Frameworks

Tech Stack

Tools & technologies

AirflowAWSAzureCloudITSMPySparkPythonSparkSQLUnity

About the role

Key responsibilities & impact

Build out and configure a dedicated Government workspace within the existing Databricks environment
Design and implement data ingestion pipelines from core agency business systems, including financial, HR, CRM, and ITSM systems
Leverage native/built-in connectors where source systems support them and design custom integration approaches for legacy systems
Normalize and prepare ingested data within Databricks for downstream visualization/reporting tools
Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking
Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements
Develop comprehensive as-built documentation, including physical/logical architecture diagrams, automated data dictionaries, and SOPs
Document data sources, integration methods, and data lake architecture decisions to support sustainment

Requirements

What you’ll need

5 years work experience with BS/BA; 3 years with MS/MA
US Citizenship
Active DoD Secret clearance
2 years working on the Databricks platform
Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development
Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage
Experience with pipeline orchestration tools (Airflow, Databricks Workflows)
Experience with Delta Lake, schema evolution, time travel, and optimization techniques
Experience integrating heterogeneous enterprise systems, including legacy/custom integrations
Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices
Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices
Familiarity with financial, HR, CRM, or ITSM data structures
Git/CI-CD pipeline experience
DoD 8570 certification

Benefits

Comp & perks

Potential eligibility for overtime
Potential eligibility for shift differential
Potential eligibility for a discretionary bonus