Senior Data Engineer, Digital Platforms

PCI Pharma Services

. Design, develop, optimize, and provide operational support for the enterprise Databricks and AWS data platform .

Posted 11/1/2026full-timeUnited StatesSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and developing scalable data pipelines and ETL/ELT workflows using Databricks, Spark, and PySpark, while ensuring compliance with regulatory standards such as PCI and GCP. Proficient in building CI/CD pipelines and supporting AWS-hosted infrastructure for optimal performance and security.

Highest-signal resume keywords

DatabricksSparkDelta LakePySparkAWS

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Pipeline DesignETL/ELT WorkflowsMedallion ArchitectureData ModelingCI/CD Pipeline Development

Soft Skills

CollaborationProblem-SolvingAttention to Detail

Tools & Technologies

AWS GlueAWS S3AWS LambdaData CatalogData Governance

Industry Keywords

PCI ComplianceCGMPGCPCloud SecurityIncident Response

Tech Stack

Tools & technologies

AWSCloudETLGoogle Cloud PlatformPySparkSparkSQL

About the role

Key responsibilities & impact

Design, develop, optimize, and provide operational support for the enterprise Databricks and AWS data platform
Design, develop, and maintain scalable data pipelines using Databricks, Spark, and Delta Lake
Build ETL/ELT workflows using PySpark and Databricks SQL
Implement and support Bronze, Silver, and Gold medallion architecture layers
Design and maintain 3NF, star schema, and canonical data models
Support Data Catalog and Data Governance frameworks for data quality and compliance
Build and maintain CI/CD pipelines for reliable deployment across environments
Collaborate with external development partners on development and production support
Provide operational support for AWS-hosted infrastructure, application services, data services, and system integrations
Monitor cloud environments for availability, performance, security, and cost efficiency; escalate risks and issues to the Technical Lead
Support deployments and ensure environment readiness with DevOps and technical stakeholders
Contribute to cloud operational best practices for scalability, resilience, security, and incident response
Support UAT and validation by reviewing test cases, triaging defects, and ensuring test environment readiness and stability
Provide technical input during release readiness discussions and risk evaluations
Collaborate with Product Managers, Project Managers, QA, DevOps, and external development partners on solution delivery and platform stability
Translate business and operational requirements into scalable technical solutions aligned with approved architecture and enterprise standards
Support secure and reliable integration with internal enterprise systems and data sources
Ensure adherence to PCI, cGMP, GCP, and regulatory policies
Participate in occasional overtime and/or weekend work for critical releases or production needs
Perform additional duties as assigned by the Data Platform Technical Lead or management

Requirements

What you’ll need

Hands-on experience with Databricks, Spark, Delta Lake, PySpark, and Databricks SQL
Experience designing scalable data pipelines and ETL/ELT workflows
Experience implementing medallion architecture (Bronze, Silver, Gold layers)
Experience with data modeling, including 3NF, star schema, and canonical models
Experience supporting Data Catalog and Data Governance frameworks
Experience building and maintaining CI/CD pipelines
Hands-on experience with AWS Glue, S3, and Lambda
Experience supporting AWS-hosted infrastructure, application services, data services, and system integrations
Knowledge of cloud availability, performance, security, cost efficiency, scalability, resilience, and incident response
Experience supporting User Acceptance Testing and validation activities
Ability to review test cases, triage defects, and ensure test environment readiness
Ability to translate business and operational requirements into scalable technical solutions
Ability to support secure and reliable integrations with enterprise systems and data sources
Ability to adhere to PCI, cGMP, GCP, and regulatory policies
Willingness to participate in occasional overtime and/or weekend work
Consistent attendance and reliable availability
Senior individual-contributor-level expertise in enterprise data platform engineering