Data Engineer, Databricks

Parra Consulting Group, Inc.

. Design, build, and maintain robust, end-to-end data pipelines for an enterprise Lakehouse on Databricks and AWS .

Posted 10/27/2026full-timeRemote • Maryland • United StatesSeniorLeadWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and managing ETL processes and data pipelines, with a strong focus on data modeling within a Bronze, Silver, and Gold medallion architecture. Proficient in optimizing pipeline performance and ensuring data security and compliance while collaborating with cross-functional teams.

Highest-signal resume keywords

ETL Process DevelopmentDatabricks Pipeline OptimizationPython and PySpark CodingAWS Services UtilizationData Modeling Expertise

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

ETL ProcessesData PipelinesData ModelingSQL AnalysisPerformance OptimizationPythonPySparkDatabricksDelta LakeUnity Catalog

Tools & Technologies

Databricks NotebooksAWS GlueAmazon S3Amazon RDSAI-Assisted Coding Tools

Certifications & Qualifications

Bachelor’s Degree in Computer SciencePublic Trust or Suitability/Fitness Determination

Industry Keywords

Data EngineeringLakehouse ArchitectureBronze Silver Gold MedallionData SecurityCompliance

Tech Stack

Tools & technologies

AWSETLPySparkPythonSQLUnity

About the role

Key responsibilities & impact

Design, build, and maintain robust, end-to-end data pipelines for an enterprise Lakehouse on Databricks and AWS
Develop and manage ETL processes with comprehensive logging and error handling to troubleshoot and resolve issues
Design data models within a Bronze, Silver, and Gold medallion architecture, selecting dimensional or relational approaches as appropriate
Analyze and decompose complex legacy SQL, rebuild pipelines and models, and compare results to validate accuracy and performance
Optimize pipeline performance and scalability using techniques such as partitioning, bucketing, and caching
Use AI-assisted coding tools to accelerate pipeline analysis, data engineering, and data modeling tasks
Help ensure data security and compliance
Collaborate with cross-functional teams to deliver analytics-ready data

Requirements

What you’ll need

Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Math, Physics, or Information Systems and Technology
8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines
Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
U.S. citizenship required to support this federal contract
3+ years of experience building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools, including Delta Lake and Unity Catalog
3+ years of experience writing Python and PySpark code for ETL scripts and custom transformations
Experience using AI-assisted coding tools, such as Claude Code or Cursor, to support data engineering and data modeling tasks
Experience with data modeling, including selecting dimensional or relational models, within a Bronze, Silver, and Gold medallion architecture
Experience using AWS services, including AWS Glue, Amazon S3, and Amazon RDS
Knowledge of ETL performance optimization techniques, such as partitioning, bucketing, and caching, and experience troubleshooting query performance
Ability to analyze and decompose complex legacy SQL, rebuild data pipelines or models, and compare results to validate accuracy and performance