Data & Analytics Expert

Allstate

. Lead the architecture and design of complex, enterprise-scale data solutions across cloud, lakehouse, warehouse, streaming, and analytical platforms .

Posted 10/30/2026full-timeRemote • Illinois • United StatesSeniorLead💰 $120,000 - $193,725 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing complex, enterprise-scale data solutions using advanced programming languages and cloud technologies. Proficient in data architecture, integration, governance, and leading cross-functional technical initiatives.

Highest-signal resume keywords

Data ArchitecturePython ProgrammingMicrosoft Fabric SolutionsCloud Services (Azure/AWS)Data Governance

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringData ModelingDistributed ProcessingSQL OptimizationBatch ProcessingStreaming ArchitecturesData Quality ManagementMetadata ManagementObservability PlatformsCI/CD Automation

Soft Skills

Technical LeadershipCommunication SkillsMentoringCollaborationInfluencing Without Authority

Tools & Technologies

Apache SparkKafkaFlinkDatadogGitAzureAWSDelta LakeLakehouse ArchitectureEvent-Driven Processing

Industry Keywords

Enterprise Data SolutionsData IntegrationData Lifecycle ManagementCloud ArchitectureData Security

Tech Stack

Tools & technologies

ApacheAWSAzureCloudKafkaNoSQLPySparkPythonScalaSparkSQL

About the role

Key responsibilities & impact

Lead the architecture and design of complex, enterprise-scale data solutions across cloud, lakehouse, warehouse, streaming, and analytical platforms
Define scalable architectural patterns for data ingestion, transformation, storage, integration, consumption, and lifecycle management
Provide technical direction for complex initiatives involving multiple applications, data domains, platforms, and engineering teams
Establish standards for data modeling, interoperability, metadata, lineage, security, performance, and platform integration
Lead technical design reviews and evaluate architectural trade-offs
Serve as a technical escalation point for complex data architecture, engineering, integration, and production challenges
Guide modernization of legacy data platforms and workloads using modern cloud and distributed data technologies
Design and lead implementation of scalable batch, streaming, and event-driven data processing solutions
Develop complex data solutions using Python, PySpark, Scala, SQL, or comparable languages
Apply distributed processing technologies such as Apache Spark, Kafka, Flink, dbt, or equivalent frameworks
Design reusable engineering frameworks and patterns across multiple data products and teams
Design dimensional, relational, lakehouse, and domain-oriented data models
Optimize distributed workloads, SQL queries, storage organization, partitioning strategies, and data pipelines
Establish practices for automated testing, dependency management, orchestration, failure recovery, replay, and operational resilience
Provide technical leadership for Microsoft Fabric solutions, including Lakehouse, Warehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, and Semantic Models
Apply Azure and/or AWS cloud services to enterprise data architectures
Define and promote Git-based version control, code review, automated testing, CI/CD, and automated deployment
Design observability strategies and drive monitoring and operational excellence using Datadog or equivalent technologies
Lead root-cause analysis for complex production issues and prevent recurrence
Define and implement data quality, metadata management, lineage, retention, classification, and lifecycle management practices
Partner with business owners, data custodians, governance teams, security teams, and architects to establish trusted, governed data products
Evaluate emerging data technologies and recommend adoption
Lead modernization initiatives and migrations from legacy data ecosystems to modern cloud and lakehouse platforms
Apply generative AI and agentic AI tools where appropriate
Partner with senior business and technology leaders to translate business needs into long-term data capabilities
Communicate technical topics, architectural decisions, risks, and trade-offs to technical and non-technical audiences
Facilitate discussions across engineering, product, analytics, governance, and business teams
Influence technical direction across multiple teams without direct supervisory authority
Mentor engineers and create technical documentation, reference architectures, standards, and reusable implementation guidance

Requirements

What you’ll need

10 or more years of relevant technology, data engineering, data architecture, or data platform experience (Preferred)
Significant experience designing and delivering complex, enterprise-scale data solutions
Demonstrated experience providing technical leadership across large or cross-functional initiatives
Expert-level knowledge of data architecture, data engineering, distributed processing, data integration, and data modeling
Advanced proficiency in Python, PySpark, Scala, SQL, or comparable languages used for large-scale data processing
Advanced understanding of Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Notebooks, Data Pipelines, Dataflows Gen2, and Semantic Models
Strong knowledge of Delta Lake, lakehouse architecture, distributed computing, batch processing, and streaming architectures
Advanced SQL expertise, including query optimization and performance tuning
Strong understanding of relational, dimensional, NoSQL, and distributed data modeling techniques
Experience designing reusable frameworks and enterprise-scale data processing patterns
Strong knowledge of cloud architecture and data services within Microsoft Azure and/or AWS
Advanced understanding of Git, CI/CD, automated testing, infrastructure/deployment automation, and release management
Experience with observability platforms such as Datadog
Strong understanding of data governance, metadata, lineage, data quality, security, privacy, and retention principles
Demonstrated ability to troubleshoot complex distributed data and production problems
Demonstrated ability to lead technical initiatives and influence engineering standards across multiple teams
Excellent communication skills
Must submit to a background investigation
Allstate generally does not sponsor individuals for employment-based visas for this position
Dedicated, private workspace free from distractions when working from home
Reliable internet with minimum speeds of 50 MB download and 5 MB upload

Benefits

Comp & perks

Comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse
Monthly connectivity reimbursement for employees eligible to work from home
Remote work arrangement
Opportunity to challenge the status quo and shape the future of protection
Support for causes that mean the most to employees