Data Engineer

You.com

. Build and maintain scalable data pipelines (batch and streaming) using Databricks, Spark, Kafka, and AWS services .

Posted 9/18/2026full-timeSan Francisco • California • United StatesMid-LevelSenior💰 $180,000 - $220,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and maintaining scalable data pipelines using Databricks, Spark, and AWS services, with a strong focus on ETL/ELT workflows and data quality assurance. Proficient in collaborating with cross-functional teams to develop finance data solutions and analytics for business performance.

Highest-signal resume keywords

DatabricksAWS ServicesETL/ELT WorkflowsPython (PySpark)SQL

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringETL/ELT Pipeline DevelopmentData Ingestion ToolsData ModelingLarge-Scale Data Processing

Soft Skills

Problem-SolvingCommunicationCollaboration

Tools & Technologies

KafkaFivetranDBTAirflowBI Tools

Industry Keywords

Finance MetricsRevenue AccountingData Quality ChecksAI/ML Data PipelinesReverse ETL

Tech Stack

Tools & technologies

AirflowAWSETLKafkaPySparkPythonSparkSQL

About the role

Key responsibilities & impact

Build and maintain scalable data pipelines (batch and streaming) using Databricks, Spark, Kafka, and AWS services
Build and maintain pipelines from source systems including Salesforce, billing, product events, and API logs into clean analytics layers
Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and Fivetran
Work closely with Finance in developing Finance data solutions, Finance metrics, and forecasting models
Partner with Finance on revenue accounting, COGS, and margin reporting
Partner with marketing and growth teams to enable segmentation, campaign targeting, and lifecycle analytics
Develop and maintain reverse ETL pipelines syncing warehouse data to Salesforce, HubSpot, Braze, and other downstream systems
Create and manage curated datasets supporting analytics, reporting, and go-to-market initiatives
Build and maintain dashboards and reporting layers for marketing and business performance tracking
Support AI/ML and agent-based applications by preparing and serving high-quality datasets for MCP integrations and AI-driven applications
Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality
Implement data quality checks, validations, and alerting mechanisms across ingestion and activation layers
Collaborate with cross-functional teams to define data contracts and ensure consistency across systems

Requirements

What you’ll need

6+ years of experience in data engineering or a related field
Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka
Proficiency in Python (PySpark) and SQL for large-scale data processing
Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)
Experience with data ingestion tools such as Fivetran (or similar)
Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze
Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows
Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus
Experience working with Finance and building finance specific metrics and pipelines is a strong plus
Understanding of data modeling and working with large-scale datasets (batch and streaming)
Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences
Strong problem-solving skills and ability to debug production data issues
Strong communication skills and ability to work collaboratively across teams
Authorization to work in the United States, as indicated by You.com's E-Verify participation and Form I-9 verification process

Benefits

Comp & perks

Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
12 weeks of paid parental leave in the US*
401k program, 3% match - vested immediately!*
$500 work-from-home stipend to be used up to a year of your start date*
$600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
$1,200 per year Health & Wellness Allowance to support your personal goals*
The chance to collaborate with a team at the forefront of AI research