Data Platform Engineer

Employer Direct Healthcare

. Administer Azure Databricks and Unity Catalog, including workspace and metastore configuration, catalog and schema structure, cluster policies, and compute cost management.

Posted 10/6/2026full-timeDallas • Texas • United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in administering Azure Databricks and PostgreSQL, with a strong focus on Infrastructure-as-Code using Terraform. Proficient in CI/CD pipeline management and enforcing security standards in regulated environments.

Highest-signal resume keywords

Azure Databricks AdministrationPostgreSQL AdministrationInfrastructure-as-Code with TerraformCI/CD Pipeline Management with GitHub ActionsIdentity and Access Architecture

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Azure DatabricksPostgreSQLTerraformCI/CDPythonUnity CatalogDelta LakeOBO AuthenticationData MaskingPerformance Tuning

Soft Skills

Problem-SolvingCommunicationCollaborationTroubleshooting

Tools & Technologies

GitHubDatadogAzure DevOpsKey VaultEntra ID

Industry Keywords

HIPAASOC 2Regulated EnvironmentHealthcare DataData Mesh

Tech Stack

Tools & technologies

AzureCloudPostgresPythonSQLTerraformUnityVault

About the role

Key responsibilities & impact

Administer Azure Databricks and Unity Catalog, including workspace and metastore configuration, catalog and schema structure, cluster policies, and compute cost management.
Build self-serve provisioning workflows, templates, and access patterns for domain data teams.
Administer the Lakebase managed PostgreSQL estate, including provisioning, user and role management, connection configuration, performance tuning, upgrades, backup and point-in-time recovery, and incident response.
Build and maintain Terraform-based Infrastructure-as-Code for Azure resource groups, networking, private endpoints, Entra ID app registrations, service principals, and Key Vault.
Implement and enforce access controls including Unity Catalog grants, OBO authentication, ABAC, row-level security, data masking, and role-based access.
Build audit logging, lineage capture, sensitivity classification tagging, and custom event-sourced audit capabilities.
Operate observability across Databricks, Lakebase, and Azure services, including Datadog integration, metrics, log export, alerting, and SLOs.
Execute infrastructure lifecycle management, backup and restore validation, and disaster recovery testing.
Support CI/CD for notebooks, jobs, DLT pipelines, dbt projects, Databricks Asset Bundles, and Lakebase schema migrations.
Maintain GitHub and GitHub Actions integrations, repository structure, branch policies, and CI/CD workflows.
Collaborate with Cloud Platform, Azure SQL DBA, Security, InfoSec, and Core Apps teams on shared foundations, integrations, dependencies, and regulatory requirements.
Engage in domain-team project kickoffs, advise on platform capabilities and access patterns, and serve as an escalation point for platform issues.
Produce platform KPI reporting and contribute to the platform-as-product roadmap and backlog.
Document reusable patterns from kickoffs, incidents, and liaison work.
Provide occasional availability outside core hours for scheduled deployments and major incidents; there is no overnight on-call rotation.

Requirements

What you’ll need

A minimum of 4 years in a platform or infrastructure engineering role supporting a data or analytics organization.
Deep hands-on experience with Databricks (workspace administration, Unity Catalog, Delta Lake) and Azure (Entra ID, networking, Key Vault, Infrastructure-as-Code via Terraform or Bicep).
Hands-on PostgreSQL administration experience, including user and role management, connection configuration, query and index performance tuning, backup and restore, point-in-time recovery, and HA/DR.
Real experience with identity and access architecture, including service principals versus user-authorization (OBO) patterns and their tradeoffs.
Practical experience building and maintaining CI/CD pipelines with GitHub Actions and/or Azure DevOps.
Proficiency with Python or another scripting language for platform automation and tooling.
Experience using AI tools such as GitHub Copilot, ChatGPT, or Claude to accelerate engineering work.
Comfort owning the infrastructure lifecycle: provisioning, decommissioning, and disaster recovery.
Experience working in a regulated environment, ideally healthcare, with HIPAA and/or SOC 2 requirements.
Comfort operating with elevated privileges in a regulated, PHI-bearing environment, with judgment to escalate rather than grant exceptions unilaterally.
Ability to enforce architecture and security standards through influence and automation rather than authority.
Strong problem-solving and troubleshooting ability, including under incident conditions.
Excellent communication and collaboration skills, and ability to work effectively with cross-functional engineering teams.
Strong candidates may have exposure to data mesh or domain-oriented data architecture; Databricks Lakebase or another cloud-native Postgres service; Azure SQL Database; OLTP-to-lakehouse integrations; healthcare data environments; Datadog or OpenTelemetry; Databricks Asset Bundles, DLT, or dbt; and relevant certifications.

Benefits

Comp & perks

Medical Insurance
Dental Insurance
Vision Insurance
Short & Long Term Disability
Life Insurance
401k with company match
Flexible Time Off
Paid Parental Leave