Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
EXL

Lead Data Engineer

EXL

. Design and implement end-to-end data pipelines using PySpark, Snowflake, and AWS cloud services .

Posted 9/29/2026full-timeJersey City • New Jersey • United StatesSenior💰 $120,000 - $160,000 per yearWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing end-to-end data pipelines using PySpark and Snowflake, while leveraging AWS services for cloud-based solutions. Proven ability to lead data migration efforts and collaborate effectively with cross-functional teams in regulated industries.

Highest-signal resume keywords
Data Pipeline DesignSnowflake Data ModelingAWS Services ProficiencyApache Spark / PySpark FrameworksSQL Transformations and Optimization

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Data Pipeline DevelopmentSQL TransformationsData Warehouse DesignCloud MigrationPerformance TuningData Quality ValidationPython ProgrammingAgile/Scrum MethodologyELT/ETL WorkflowsData Engineering Standards
Soft Skills
Stakeholder EngagementTeam CoordinationMentoringCommunicationRequirement Gathering
Tools & Technologies
AWS S3AWS GlueAWS LambdaAWS EMRAWS RedshiftAWS Step FunctionsAWS CloudWatchApache AirflowDbtData Vault
Industry Keywords
Insurance AnalyticsFinancial ServicesRegulated IndustriesData EngineeringCloud-Native Platforms

Tech Stack

Tools & technologies
AirflowAmazon RedshiftApacheAWSCloudETLPySparkPythonSparkSQLVault

About the role

Key responsibilities & impact
  • Design and implement end-to-end data pipelines using PySpark, Snowflake, and AWS cloud services
  • Architect scalable ELT/ETL workflows and data warehouse models supporting insurance analytics use cases
  • Drive data migration and modernization efforts from legacy environments to cloud-native platforms
  • Develop and review complex SQL transformations, stored procedures, and data quality validation frameworks
  • Establish and enforce data engineering standards, coding best practices, and pipeline documentation
  • Provide hands-on troubleshooting and performance optimization across the data stack
  • Coordinate day-to-day activities across onshore and offshore data engineering teams to ensure timely delivery
  • Serve as a technical point of contact for business stakeholders, translating requirements into engineering deliverables
  • Facilitate requirement-gathering sessions, sprint planning, and status updates with project teams
  • Communicate project progress, risks, and dependencies to project managers and client stakeholders
  • Mentor junior engineers and conduct code reviews to uphold quality standards
  • Collaborate with data architects, analysts, and QA teams throughout the project lifecycle

Requirements

What you’ll need
  • 6–9 years of progressive experience in data engineering
  • Prior experience in insurance, financial services, or regulated industries preferred
  • Experience coordinating distributed teams across time zones (onshore/offshore model)
  • Demonstrated ability to engage with non-technical stakeholders and translate business requirements
  • Exposure to Agile/Scrum delivery methodology
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
  • Deep experience with Snowflake including data modeling and performance tuning
  • Proficiency with AWS services — S3, Glue, Lambda, EMR, Redshift, Step Functions, CloudWatch
  • Strong experience building distributed data processing frameworks with Apache Spark / PySpark
  • Advanced SQL skills — complex transformations, query optimization, and dimensional modeling
  • Expertise in DWH design patterns — Kimball, Inmon, Data Vault, star and snowflake schemas
  • Demonstrated experience leading or contributing to cloud migration and legacy modernization programs
  • Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks
  • Solid Python programming for data engineering and automation tasks

Benefits

Comp & perks
  • Benefits information provided at https://www.exlservice.com/us-careers-and-benefits