Data Engineer

People Data Labs

. Build infrastructure for ingestion, transformation, and loading of increasing data volumes from diverse sources using Spark, SQL, AWS, and Databricks .

Posted 10/27/2026full-timeRemote • United StatesMid-LevelSenior💰 $180,000 - $220,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building scalable data processing systems and developing CI/CD pipelines while leveraging tools such as Apache Spark, SQL, and AWS. Strong problem-solving skills are essential for addressing complex data engineering challenges and collaborating effectively with teams.

Highest-signal resume keywords

Apache Spark ExpertisePython ProgrammingData Pipeline DevelopmentAWS Cloud ServicesEntity Resolution Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

SQLData WarehousingData DesignData IntegrationData Quality EvaluationStreaming PlatformsData Processing SystemsIncremental UpdatingPartitioningSchema Design

Soft Skills

Strong Written CommunicationProject ManagementCollaborationProblem-SolvingAutonomy

Tools & Technologies

DatabricksAirflowDbtDagsterKafkaNumPyPandasDelta LakeSnowflakeBigQuery

Industry Keywords

Data EngineeringData ScienceCloud ComputingData AcquisitionData IntegrationEntity DataRecord LinkageData Lakehouse PatternsModern Data Storage FormatsQuantitative Discipline

Tech Stack

Tools & technologies

AirflowAmazon RedshiftApacheAWSAzureBigQueryCloudGoogle Cloud PlatformJavaKafkaNumpyPandasPythonScalaSnowflakeSparkSQL

About the role

Key responsibilities & impact

Build infrastructure for ingestion, transformation, and loading of increasing data volumes from diverse sources using Spark, SQL, AWS, and Databricks
Build an organic entity resolution framework to merge hundreds of billions of individual entities into clean, consumable datasets
Develop CI/CD pipelines and anomaly detection systems to continuously improve production data quality
Devise solutions to undefined data engineering and data science problems
Collaborate with the Data Engineering Team and stakeholders while managing project scope, progress, and blockers

Requirements

What you’ll need

3-5+ years of industry experience with clear examples of strategic technical problem-solving and implementation
Strong software development fundamentals
Experience with Python
Expertise with Apache Spark (Java, Scala, and/or Python-based)
Experience with SQL
Experience building scalable data processing systems from the ground up
Experience using developer-oriented data pipeline and workflow orchestration such as Airflow, dbt, or Dagster
Knowledge of modern data design and storage patterns, including incremental updating, partitioning and segmentation, rebuilds and backfills
Experience working in Databricks, including Delta Live Tables and data lakehouse patterns
Experience with cloud computing services such as AWS, GCP, Azure, or similar
Experience with data warehousing such as Databricks, Snowflake, Redshift, or BigQuery
Understanding of modern data storage formats and tools such as Parquet, ORC, Avro, and Delta Lake
Ability to balance high ownership and autonomy with collaboration
Ability to work effectively remotely
Strong written communication skills on Slack/Chat and in documents
Experience writing data design documents covering pipeline design, dataflow, and schema design
Ability to scope and break down projects and communicate progress and blockers
Experience with entity data, entity resolution, or record linkage
Experience with data acquisition or data integration
Experience with Python data stack such as NumPy and pandas
Experience with streaming platforms such as Kafka
Experience evaluating data quality and maintaining high data standards
Authorization to work in the United States is queried in the application form
Degree in a quantitative discipline is listed as a nice-to-have, not a requirement

Benefits

Comp & perks

Stock
Competitive Salaries
Unlimited paid time off
Medical, dental, & vision insurance
Health, fitness, and office stipends
The permanent ability to work wherever and however you want