Engineering Manager, Big Data

ZipRecruiter

. Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores .

Posted 11/9/2026full-timeRemote • United StatesMid-LevelSenior💰 $200,000 - $265,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in leading engineering teams and improving data ingestion pipelines while ensuring high data quality and performance. Proficient in modern big data frameworks and containerization technologies to support scalable solutions.

Highest-signal resume keywords

Software Engineering LeadershipBig Data FrameworksStreaming TechnologiesContainerization TechnologiesProduct-Oriented Problem-Solving

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software DevelopmentData StructuresAlgorithmsData IngestionData Quality ImprovementFraud DetectionData IntegrationData MigrationCoding SkillsReal-Time Data Processing

Soft Skills

MentoringCollaborationProblem-Solving

Tools & Technologies

SparkHadoopHiveKafkaFlinkBeamDockerKubernetes

Industry Keywords

B2C ProductB2B ProductUser-Generated ContentData PipelinesJob Intelligence

Tech Stack

Tools & technologies

DockerHadoopKafkaKubernetesSpark

About the role

Key responsibilities & impact

Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores
Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams
Prioritize initiatives that improve input data quality and handle low-structure, user-generated content
Own and lead improvements to fraud detection and blocking mechanisms
Partner with Engineering stakeholders, Data Scientists, and a Product Manager to balance requests and roadmap priorities
Scale data pipelines for performance and maintainability
Enable scalable real-time action on job intelligence and support personalized job seeker experiences

Requirements

What you’ll need

5+ years of professional software development experience
2+ years of experience as a software engineering leader
Deep experience with modern big data frameworks, such as Spark, Hadoop, and Hive
Experience with streaming technologies, including Kafka, Flink, and Beam
Strong computer science fundamentals in data structures and algorithms
Strong coding skills
Experience with containerization technologies such as Docker and Kubernetes
Experience working on a B2C or B2B product
Experience dealing with messy or unreliable data, including third-party datasets, data integrations, and migrations
Product-oriented problem-solving ability and understanding of the product worked on

Benefits

Comp & perks

Competitive compensation
Exceptional benefits package
Flexible Vacation & Paid Time Off
Employer-matched 401(k) plan
Medical, financial, and other benefits
Equity, bonuses, commission, or other forms of compensation may also be provided depending on the position offered