Staff Data Engineer

Illumina

. Partner across business, AI, and platform teams to translate domain needs such as SAP, Manufacturing, and Quality into well-modeled, governed, scalable data products .

Posted 9/23/2026full-timeSan Diego • California • United StatesLead💰 $141,600 - $212,400 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in building and scaling data products using Databricks and Snowflake, with strong proficiency in Python and advanced SQL for data modeling. Capable of embedding data quality and governance practices while leading technical discussions and mentoring teams.

Highest-signal resume keywords

Data Engineering ExperiencePython Framework DevelopmentAdvanced SQL SkillsDistributed Systems UnderstandingData Governance Practices

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonSQLData ModelingSparkDelta LakeDbtData PipelinesData QualityAI AdoptionCloud Platforms

Soft Skills

Strong Communication SkillsMentoringTechnical Leadership

Tools & Technologies

DatabricksSnowflakeUnity CatalogPower BITableau

Certifications & Qualifications

Databricks CertificationDbt Certification

Industry Keywords

SAPManufacturingQualityGxP21 CFR Part 11

Tech Stack

Tools & technologies

ApacheAWSCloudDistributed SystemsPythonSparkSQLTableauUnity

About the role

Key responsibilities & impact

Partner across business, AI, and platform teams to translate domain needs such as SAP, Manufacturing, and Quality into well-modeled, governed, scalable data products
Design, build, and scale end-to-end data products on Databricks interoperating with Snowflake, from ingestion through curated analytics-ready datasets using Bronze/Silver/Gold architecture
Develop reusable Python frameworks, libraries, and standardized patterns for ingestion, transformation, validation, and publishing
Design relational, dimensional, and lakehouse data models
Build performant and reliable distributed data pipelines using Spark, Delta Lake/open table formats, dbt, and SQL
Embed data quality, reconciliation, validation, and governance into pipelines, including Unity Catalog lineage, RBAC, masking, and PII handling
Monitor, alert, troubleshoot, perform root-cause analysis, and maintain SLA adherence for business-critical datasets
Adopt AI in day-to-day data and analytics engineering to accelerate development, testing, and optimization
Set technical standards, lead code reviews, contribute to architecture decisions, mentor engineers, and communicate trade-offs
Provide end-to-end ownership for data products from design through production support
Mentor engineers on the global India-based team

Requirements

What you’ll need

10+ years of professional data engineering experience building and scaling data products on cloud platforms such as Databricks and/or Snowflake
Strong proficiency in Python, including reusable framework development using functional and object-oriented programming
Advanced SQL and strong data modeling skills (relational, dimensional, and lakehouse)
Solid understanding of distributed systems and system design for large-scale data processing
Hands-on experience with open table formats (Delta Lake and/or Apache Iceberg) and big-data file formats (Parquet)
Experience with Spark and modern ELT tooling such as dbt
Experience with data observability, governance, security, and compliance practices (RBAC, PII, SOX)
Demonstrated adoption of AI in data and analytics engineering workflows
Software engineering foundation including Git, REST APIs, JSON, and CI/CD on at least one cloud environment; AWS preferred
Strong written and verbal communication skills, with ability to work across business, AI, and platform teams and lead technical discussions
Bachelor's degree in Computer Science, Data Science, Information Systems, Engineering, Mathematics, or a related field, or equivalent demonstrable experience
Preferred: domain knowledge of SAP, Manufacturing, and/or Quality data and processes
Preferred: experience in GxP / 21 CFR Part 11 or comparable regulated environments
Preferred: experience with Unity Catalog and lakehouse governance at scale
Preferred: Snowflake-to-Databricks migration experience
Preferred: exposure to SAP ECC / S/4HANA, CDS views, and SAP data integration patterns
Preferred: Databricks and/or dbt certifications
Preferred: familiarity with Power BI / Tableau and BI and conversational analytics

Benefits

Comp & perks

Variable cash programs (bonus or commission)
Equity for eligible roles
Access to genomics sequencing
Family planning benefits
Health, dental, and vision benefits
Retirement benefits
Paid time off
Employee Resource Groups offering career development experiences, cultural awareness, and social responsibility opportunities
Workplace accommodations for the application or interview process