Lead Data Engineer
Astrana Health
Posted: 10/20/2026ApacheAWSAzureCloudETLGraphQLPostgresPySparkPython+4 more
IT Architect, Data Scientist
DLH Corporation
Posted: 10/20/2026CloudCyber SecurityPython
Staff Software Engineer – Data Engineer
Walmart
Posted: 10/20/2026BigQueryCloudJavaKafkaKubernetesMavenMicroservicesNoSQLPython+4 more
Data Engineering Intern
American Family Insurance
Posted: 10/20/2026Amazon RedshiftAWSBigQueryCloudDockerETLGoogle Cloud PlatformPythonSQL+1 more
Senior Staff Data Migration Engineer
Alkami Technology
Posted: 10/20/2026ETLSQL
Senior Software Engineer, Data Acquisition
People Data Labs
Posted: 10/20/2026AirflowAmazon RedshiftApacheAWSBigQueryCloudDistributed SystemsDNSETL+4 more
Senior Consultant – Data Platforms, Architecture
3Cloud
Posted: 10/20/2026AzureETLSQLSSIS
Senior Data Platform Engineer
Sola
Posted: 10/20/2026Amazon RedshiftAWSDynamoDBJavaScriptMS SQL ServerMySQLNoSQLPostgresPython+3 more
Data Architect – Microsoft Fabric
NBCUniversal
Posted: 10/20/2026AzureCloudITSMKafkaPySparkPythonSQLTerraform
Senior Data Engineer
Qventus, Inc
Posted: 10/20/2026CloudTableau
Manager, Cloud and Data Platform Engineer
CVS Health
Posted: 10/20/2026AirflowBigQueryCloudDockerETLGoogle Cloud PlatformKubernetesPythonRedis+1 more
Senior Data Engineer
Vericast
Posted: 10/20/2026AirflowApacheAWSAzureCloudDistributed SystemsETLGoogle Cloud PlatformHadoop+4 more
Director, Data Engineering
Healogics, LLC.
Posted: 10/20/2026Cyber SecurityETLSQL
Data Engineer I
Pekin Insurance
Posted: 10/20/2026AirflowETLPythonSQL
Data Engineer
General Dynamics Information Technology
Posted: 10/20/2026ApacheCloudETLPySparkPythonSparkSQL
Data Engineer
RTX
Posted: 10/20/2026CloudETLMatillionPythonSQL
Senior Business Data Engineer
Nex
Posted: 10/20/2026AWSPythonSQL
Senior QA Data Engineer
Gradient AI
Posted: 10/20/2026AirflowCypressPythonSparkSQL
Data Engineer, Consultant
Thought Logic Consulting
Posted: 10/20/2026Cloud
Consultant, Data Engineer
Thought Logic Consulting
Posted: 10/20/2026Cloud
Lead Data Engineer
Astrana HealthCore Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and optimizing data pipelines and platforms using Databricks, Apache Spark, and SQL, while ensuring data governance and quality. Proven ability to lead design efforts, mentor teams, and implement best practices in data engineering and cloud-based solutions.
Highest-signal resume keywords
Databricks ExperiencePython ProficiencyData Pipeline OptimizationData Modeling ExpertiseCI/CD Implementation
Tech Stack
Tools & technologiesAbout the role
Key responsibilities & impact- Lead the design, development, and delivery of core platform components, including the Constellation Lakehouse in Databricks, Connect API (GraphQL) layer, and Lakebase-backed applications
- Build and maintain scalable batch and incremental data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake
- Integrate data from transactional databases, APIs, files, and external partners into governed datasets
- Design and maintain unified healthcare data models spanning membership, providers, claims, encounters, clinical data, and other business domains
- Develop ingestion and transformation processes including change data capture, schema evolution, deduplication, historical tracking, and reconciliation
- Build and optimize data access layers and APIs with software engineering teams
- Develop and support Lakebase-backed applications and PostgreSQL data structures
- Maintain and optimize Databricks workspaces, compute resources, job orchestration, and environment configurations
- Implement data governance and access controls through Unity Catalog
- Establish automated data quality checks, reconciliation, freshness monitoring, and alerting
- Apply DevOps practices including Git, automated testing, CI/CD, infrastructure as code, and repeatable deployments
- Tune pipelines, Spark workloads, SQL queries, and compute configurations for performance, scalability, and cost efficiency
- Investigate and resolve platform incidents and pipeline failures; perform root-cause analysis
- Partner on backup, recovery, and business continuity procedures; maintain documentation and runbooks
- Conduct code and design reviews, establish engineering standards, and mentor engineers
Requirements
What you’ll need- Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field
- 5+ years of data engineering experience building and supporting enterprise data platforms and pipelines
- 3+ years of hands-on experience with Databricks in production environments
- Strong proficiency in Python, PySpark, SQL, and Apache Spark
- Experience with Delta Lake and modern lakehouse architectures
- Hands-on experience with Azure data services and cloud-based data platforms
- Strong knowledge of data modeling, relational databases, and ETL/ELT best practices
- Experience integrating enterprise databases and APIs into scalable data solutions
- Experience with Git, CI/CD pipelines, and automated deployment practices
- Proven ability to monitor, troubleshoot, and optimize data pipelines and platform performance
- Demonstrated leadership in solution design, code reviews, mentoring, and cross-functional collaboration
- Strong problem-solving and communication skills
- Preferred: Experience administering and optimizing Databricks environments, including Unity Catalog
- Preferred: Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data
- Preferred: Healthcare data experience, including claims, eligibility, provider, or clinical datasets
- Preferred: Familiarity with HL7, FHIR, and X12
- Preferred: Experience with Terraform or other infrastructure-as-code tools
- Preferred: Experience with streaming data pipelines and event-driven architectures
- Preferred: Experience supporting AI, machine learning, or NLP data workloads
- Preferred: Familiarity with regulated data environments and governance best practices
- Preferred: Experience with cloud data platform migrations and modernization initiatives
- Preferred: Azure, Databricks, or AWS certifications
Benefits
Comp & perks- Remote position based in the U.S.
- Equal Employment Opportunity and Affirmative Action employer
- Disability accommodation support during application
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
DatabricksApache SparkPySparkSQLDelta LakeData ModelingETL/ELT Best PracticesGitCI/CDData Governance
Soft Skills
Problem-SolvingCommunicationLeadershipMentoringCollaboration
Tools & Technologies
Azure Data ServicesPostgreSQLGraphQLUnity CatalogTerraform
Certifications & Qualifications
Azure CertificationDatabricks CertificationAWS Certification
Industry Keywords
Healthcare DataClaims DataEligibility DataClinical DatasetsRegulated Data Environments