Data Engineer – Client Data Operations

Limetree

. Set up new feeds from client and vendor systems, including SFTP and scheduled file deliveries .

Posted 11/4/2026full-timeRemote • United StatesMid-LevelSenior💰 $115,000 - $145,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and optimizing data pipelines using SQL, Python, and Spark, with a strong focus on data integrity and compliance in regulated environments. Proven ability to troubleshoot and resolve data issues while collaborating with cross-functional teams to ensure reliable data delivery.

Highest-signal resume keywords

SQL SkillsPython SkillsSpark ExperienceDatabricks ExperienceAWS Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringPipeline DevelopmentSchema MappingData ValidationData Transformation

Soft Skills

Attention to DetailIndependent WorkClear Communication

Tools & Technologies

SFTPAWSGitCASS/NCOAAccuZIP

Industry Keywords

Healthcare DataDigital MarketingData PrivacyRegulated Data EnvironmentsAudience Data

Tech Stack

Tools & technologies

AWSCloudPythonSparkSQL

About the role

Key responsibilities & impact

Set up new feeds from client and vendor systems, including SFTP and scheduled file deliveries
Identify source fields, changes, missing data, and inconsistent formats
Map incoming data into established schemas and tables, identify sensitive fields, and apply approved privacy and access rules
Build validation and matching steps, including record counts, identity matching or LTID assignment, and CASS/NCOA processing where relevant
Document feed inputs, transformations, checks, outputs, and failure procedures
Build and extend SQL, Python, and Spark pipelines for direct mail and digital clients
Set up scheduled jobs, file watchers, transformations, testing, and monitoring
Improve existing pipelines as source files, schemas, tools, and business requirements change
Perform daily checks and troubleshoot Databricks workflows, AWS jobs, and related tools
Investigate failures and fix root causes, including schema drift, bad source files, expired credentials, broken dependencies, stale data, and vendor-tool issues
Improve alerts, recovery steps, and runbooks
Own routine audience and mail-drop production, including suppressions, address hygiene, count reconciliation, QC, and vendor file preparation
Flag risks to scheduled client drops and recommend safe resolutions
Hand off reliable, documented data to the Senior Analytics Engineer for downstream modeling, analysis, and reporting
Partner with campaign, account, and technical colleagues to clarify requirements and resolve issues

Requirements

What you’ll need

Several years of hands-on data engineering experience, ideally four or more, including pipelines operated in production and personally diagnosed failures
Comfort taking messy or poorly documented source files through reliable production data feeds
Strong attention to detail and ability to reconcile counts, question suspicious data, and prevent recurring problems
Ability to work independently, explain technical issues plainly, and identify when business-rule or privacy questions need an owner
Strong SQL and Python skills
Practical experience with Spark or similar large-scale data processing
Production cloud data engineering experience; Databricks and AWS or comparable experience
Experience with orchestration, monitoring, schema mapping, file-based integrations, access controls, Git, testing, and operational documentation
Careful handling of personally identifiable or protected health information in regulated data environments
Direct mail and/or digital marketing audience data experience is helpful, including deduplication, suppressions, CASS/NCOA, AccuZIP, AccuTrace, USPS tracking, or digital marketing sources and APIs
Healthcare, Medicare, or health plan marketing data; SFTP, S3, Parquet, and client-facing reporting feeds are helpful backgrounds

Benefits

Comp & perks

. 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score