Data Engineer

Guardian Life

. Establish and maintain optimized, scalable data pipelines providing high-quality, consistent data to authorized Guardian and subsidiary users and applications .

Posted 11/3/2026full-timeUnited StatesSeniorLead💰 $99,150 - $162,885 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining scalable data pipelines using Python, PySpark, and SQL, while ensuring data quality and governance. Proficient in relational and NoSQL database concepts, data modeling, and cloud-native data solutions.

Highest-signal resume keywords

Data Pipeline DevelopmentData Modeling ExpertiseCloud Data SolutionsSQL ProficiencyData Governance Implementation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonPySparkSQLData ModelingData Pipeline DesignSchema DesignData Quality ControlsDistributed Data ProcessingChange Data CaptureData Analysis

Soft Skills

Communication SkillsCreative Problem-SolvingCollaborationEmotional IntelligenceAdaptability

Tools & Technologies

DatabricksPostgreSQLOracleAWS Data ServicesAmazon S3ReltioLakehouse TechnologiesSaaS IntegrationsEvent StreamsAPIs

Industry Keywords

Data EngineeringData GovernanceData WarehousingCloud-Native SolutionsMachine LearningGenerative AIData StrategyData ProfilingData MappingSAFE Experience

Tech Stack

Tools & technologies

AWSCloudNoSQLOraclePostgresPySparkPythonSQL

About the role

Key responsibilities & impact

Establish and maintain optimized, scalable data pipelines providing high-quality, consistent data to authorized Guardian and subsidiary users and applications
Collaborate with cross-functional teams to understand data requirements and translate them into effective data pipelines
Design and maintain reliable batch and real-time ingestion pipelines for databases, files, APIs, event streams, and third-party data sources
Implement schema evolution, error handling, and data quality controls
Develop and operationalize scalable data pipelines using Python, PySpark, and SQL
Transform ingested data into curated, trusted, business-ready data assets
Use Databricks to build, orchestrate, optimize, and govern production-grade data pipelines and data assets
Build governed, high-quality data assets supporting analytics, machine learning, and generative AI use cases
Design scalable dimensional and domain-oriented data models, define schemas and data contracts, and optimize data structures
Implement observability, automated data-quality checks, and proactive alerting for pipeline reliability, performance, and compliance with service-level objectives
Participate in code reviews, testing, and documentation
Stay current on data engineering trends and best practices
Develop innovative solutions for data challenges
Work with IT and business leaders to embed the Enterprise Data Strategy into transformational roadmaps and implement data governance, management, analytics, and architecture principles
Travel up to 10% within NY/NJ/PA locations

Requirements

What you’ll need

10+ years of IT experience, with 5+ years of experience as a Data Architect, data engineer, or other data professional
Expert knowledge of relational and NoSQL database concepts
Hands-on experience with PostgreSQL, Oracle, Databricks, and cloud-native data stores
Expert proficiency in logical, physical, dimensional, and domain-oriented data modeling, including schema design and data contracts
Extensive hands-on data engineering experience with distributed data processing and lakehouse technologies, including Python and PySpark on Databricks
Experience designing and optimizing large-scale data pipelines and data-warehouse architecture using batch and incremental processing, change data capture, orchestration, and schema evolution
Experience with AWS data services and modern cloud data platforms, including Amazon S3, PostgreSQL, and Databricks
Expertise with data sourcing, profiling, data mapping, and data analysis
Expert SQL skills, including complex query development, performance optimization, data transformations, and scalable data-structure design
Ability to design secure, scalable cloud-native data solutions across object storage, lakehouse platforms, SaaS integrations, relational databases, and NoSQL data stores
Excellent written and verbal communication skills and creative problem-solving skills
Ability to adapt to changing business priorities and communicate changes across different organizational levels
Ability to articulate vision and goals to team members and stakeholders
Emotional intelligence and empathy to motivate, inspire, resolve conflicts, and build positive rapport
Ability to collaborate effectively with the Product Manager and leadership
Strong listening skills and ability to provide constructive feedback
SAFE experience and ability to work on cross-functional, self-organizing development teams is a plus
Significant experience interfacing with customers and management across business and IT
Reltio proficiency
Agentic AI development with Bedrock
Legally authorized to work in the United States without current or future employer sponsorship

Benefits

Comp & perks

Support and flexibility to achieve professional and personal goals
Skill-building opportunities
Leadership development opportunities
Philanthropic opportunities
Contemporary, supportive, flexible, and inclusive benefits and resources
Benefits for full-time eligible employees
Annual, sales, or other incentive compensation may be available