Senior Data Engineer

Lumin Digital

. Design, develop, and maintain scalable, reliable, and cost-effective data platform architecture and foundational capabilities, primarily using Databricks .

Posted 11/3/2026full-timeRemote • United StatesSenior💰 $180,000 - $200,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining scalable cloud-based data platforms using Databricks, with strong capabilities in data pipeline development, performance optimization, and compliance with security and governance standards. Proficient in programming with Python and SQL, and experienced in collaborating with cross-functional teams to drive continuous improvement initiatives.

Highest-signal resume keywords

Databricks ExperienceData Pipeline DevelopmentCloud Infrastructure (AWS)Programming in PythonCI/CD Practices

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

DatabricksData Pipeline DevelopmentScalaPythonSQLApache SparkInfrastructure-as-CodeCI/CDData Processing OptimizationCloud Services

Soft Skills

CollaborationProblem-SolvingContinuous Improvement

Tools & Technologies

AWSAzureGoogle CloudApache KafkaConfluent

Industry Keywords

Data GovernanceSecurity Best PracticesRegulatory ComplianceDistributed Data ProcessingEvent-Driven Architecture

Tech Stack

Tools & technologies

ApacheAWSAzureCloudKafkaPythonScalaSparkSQL

About the role

Key responsibilities & impact

Design, develop, and maintain scalable, reliable, and cost-effective data platform architecture and foundational capabilities, primarily using Databricks
Build and optimize data pipelines, integrations, and reusable tools
Improve data processing, developer productivity, and delivery across engineering and analytics teams
Monitor and optimize data platform performance, reliability, and resource utilization
Identify opportunities to improve efficiency and reduce operational costs
Collaborate with security and engineering teams on security standards, data governance, regulatory, and compliance requirements
Partner with cross-functional stakeholders to identify platform needs and prioritize foundational improvements
Contribute to technical planning and architectural decisions
Support continuous improvement initiatives and perform other duties as assigned

Requirements

What you’ll need

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
5+ years of experience in software engineering, data engineering, or related technical disciplines
5+ years of hands-on Databricks experience designing, developing, administering, and maintaining scalable cloud-based data platforms
Experience building data pipelines, integrations, automation, and reusable tools
Experience configuring, monitoring, troubleshooting, and optimizing data platform infrastructure
Experience with cloud infrastructure and services, preferably AWS; Azure or Google Cloud also valued
Experience with Scala, Python, SQL, Apache Spark, or similar data engineering technologies
Experience with infrastructure-as-code and CI/CD practices
Experience supporting production environments and resolving complex technical issues
Experience collaborating with cross-functional engineering teams
Familiarity with streaming data platforms and event-driven architectures such as Apache Kafka or Confluent is preferred
Strong understanding of modern data platform architecture, distributed data processing, and cloud-based infrastructure
Knowledge of Databricks workspace administration, compute configuration, workflows, access management, monitoring, and cost optimization
Strong programming and scripting skills, particularly Python and SQL
Understanding of Apache Spark, Delta Lake, and data processing and storage optimization
Knowledge of cloud infrastructure, security, networking, and resource management, particularly AWS
Understanding of infrastructure-as-code, CI/CD, and automated deployment practices
Knowledge of data governance, security best practices, access controls, and platform reliability principles
Must be legally authorized to work in the United States
Role must be performed from within the continental U.S., excluding Montana, Alaska, and Hawaii
Ability to meet minimal travel requirements
Ability to occasionally lift/move up to 25 pounds

Benefits

Comp & perks

Bonus
Medical insurance
Dental insurance
Vision insurance
401(k) with company match
Flexible PTO
12 paid holidays
Paid sick leave
Paid parental and family leave
Lifestyle spending account
Tuition reimbursement
Cell phone stipend
Minimal travel, generally 12 days or less per year
Approximately two team get-togethers per year