Data Engineer

Morning Consult

. Build and maintain batch and streaming pipelines on Databricks .

Posted 11/8/2026full-timeIsraelMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and maintaining data pipelines using Python, SQL, and Spark, with a focus on data quality and performance optimization. Proficient in CI/CD practices and familiar with serverless architecture and AI coding assistants.

Highest-signal resume keywords

Production Data Pipeline DevelopmentPython ProgrammingSQL ProficiencySpark ExperienceCI/CD Implementation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Pipeline DevelopmentPythonSQLSparkCI/CDData Quality ChecksData ModelingBatch ProcessingStreaming PipelinesInfrastructure as Code

Soft Skills

CollaborationCode ReviewJudgment in AI Output Validation

Tools & Technologies

DatabricksGitAWSTerraformNoSQL DatabasesAI Coding AssistantsAmazon Bedrock AgentCore

Industry Keywords

Serverless ArchitectureCost EfficiencyData ReliabilityContinuous IntegrationContinuous Deployment

Tech Stack

Tools & technologies

AWSJavaScriptNode.jsNoSQLPythonSparkSQLTerraformTypeScript

About the role

Key responsibilities & impact

Build and maintain batch and streaming pipelines on Databricks
Transform and model data from services into clean, reliable and accessible tables
Build data quality checks and monitoring to ensure data reliability
Deploy and maintain production pipelines through CI/CD
Document data models and tables to make data discoverable and easy to use across the company
Identify opportunities to improve pipeline performance, reliability and cost efficiency
Help shape a unified place where people and AI agents can access Morning's knowledge and get reliable answers
Collaborate in a small team with guidance and code reviews from senior engineers

Requirements

What you’ll need

4+ years of experience building production data pipelines
Strong Python and SQL
Experience with Spark
Experience with serverless architecture
Experience with Git and CI/CD
Daily use of AI coding assistants such as Claude, with the judgment to validate their output
Interest in how the data is used, not just produced
Databricks experience (advantage)
AWS experience (advantage)
Terraform or other infrastructure as code (advantage)
Proficiency with SQL and NoSQL databases and CDC (advantage)
TypeScript and Node.js (advantage)
Experience building and managing AI agents (advantage)
Experience with Amazon Bedrock AgentCore (advantage)

Benefits

Comp & perks

Guidance and code reviews from senior engineers
Opportunity for work to reach production early and have company-wide impact