Data Engineer
In All Media
Posted: 10/19/2026AirflowApacheAWSCloudKafkaPySparkPythonSparkSQL
Data Engineering Consultant – Databricks
FormativGroup
Posted: 10/19/2026AWSAzureCloudETLGoogle Cloud PlatformPythonScalaSQLTableau
Data Engineer I
Dun & Bradstreet
Posted: 10/19/2026AWSAzureCloudPythonSQL
PIM Data Engineer
Caterpillar Inc.
Posted: 10/18/2026AWSAzureCloudETLGoogle Cloud PlatformInformaticaJavaJavaScriptNode.js+2 more
Senior Data Engineer – Databricks, MLOps, AWS
GoTymeX
Posted: 10/17/2026ApacheAWSETLPySparkPythonSparkSQL
Senior Data Engineer – SnowFlake
YASH Technologies
Posted: 10/16/2026AWSAzureETLPythonSQLVault
Staff Data Engineer
Walmart
Posted: 10/15/2026AirflowCloudDistributed SystemsETLHadoopHDFSJavaKafkaKubernetes+3 more
Senior Data Engineer
American Express
Posted: 10/14/2026BigQueryCassandraDistributed SystemsETLGoogle Cloud PlatformHBaseJavaMongoDBMS SQL Server+4 more
Lead Data Engineer
Assembly Global
Posted: 10/14/2026AirflowAmazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPySpark+2 more
Data Engineer
EXL
Posted: 10/14/2026ApacheAWSAzureCloudETLGoogle Cloud PlatformPythonSparkSQL
Director – Data Engineering
Marsh McLennan
Posted: 10/14/2026AWSAzureCloudGoogle Cloud PlatformPythonSparkSQLUnity
Senior Data Engineer
MoneyGram
Posted: 10/14/2026AirflowApacheAWSBigQueryCloudETLGoogle Cloud PlatformJenkinsPython+1 more
Staff Data Engineer
Walmart
Posted: 10/13/2026AirflowBigQueryCloudDistributed SystemsETLHadoopHDFSJavaKafka+4 more
Principal Data Engineer
Walmart
Posted: 10/13/2026AirflowBigQueryCloudDistributed SystemsETLHadoopHDFSJavaKafka+4 more
Staff Data Engineer
Walmart
Posted: 10/13/2026AirflowCloudDistributed SystemsETLHadoopHDFSJavaKafkaKubernetes+3 more
Principal Data Engineer
Walmart
Posted: 10/13/2026AirflowCloudDistributed SystemsETLHadoopHDFSJavaKafkaKubernetes+3 more
Senior Data Engineer
Walmart
Posted: 10/13/2026AirflowCloudDistributed SystemsETLHadoopHDFSJavaKafkaKubernetes+4 more
Senior Data Engineer
Walmart
Posted: 10/13/2026AirflowBigQueryCloudDistributed SystemsETLHadoopHDFSJavaKafka+4 more
Data Engineer
Expleo Group
Posted: 10/13/2026ApacheAWSAzureCloudETLKafkaPySparkPythonSpark+2 more
Data Engineer
Capgemini
Posted: 10/13/2026AirflowAWSCloudPythonSQL
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in data engineering with a focus on migrating large-scale datasets to Snowflake, optimizing SQL queries, and managing data pipelines using Apache Airflow and Apache Kafka. Proficient in Python development and implementing testing strategies to ensure data quality and performance.
Highest-signal resume keywords
Data Engineering ExperienceSnowflake Data ModelingApache Airflow Pipeline ManagementAdvanced SQL SkillsApache Kafka Streaming
Tech Stack
Tools & technologiesAbout the role
Key responsibilities & impact- Execute the end-to-end migration of approximately 1,000 datasets to Snowflake
- Upgrade orchestration workflows from Apache Airflow 2 to Airflow 3
- Migrate legacy Hive data structures and datasets to Apache Iceberg using the Snowpark Connect framework/connectors
- Reconfigure, update, and migrate Confluent/Apache Kafka streaming connections across cloud regions
- Adapt existing data pipelines to target Snowflake environments
- Optimize SQL queries using CTEs, window functions, and complex joins
- Manage, test, and debug DAGs and workflow scheduling in Apache Airflow
- Implement testing strategies and conduct hands-on code debugging to ensure data quality and consistency
- Modernize streaming infrastructure across cloud regions and uphold data quality and performance standards
- Collaborate with the Data Platform team on a major data platform modernization initiative
Requirements
What you’ll need- Minimum 2+ years of hands-on data engineering experience working with large-scale datasets, Apache Airflow, and Apache Spark
- Strong software engineering fundamentals
- Hands-on Python development experience
- Advanced SQL skills, including complex joins, CTEs, window functions, and query tuning
- Proven experience with Snowflake data modeling and schema architecture
- Direct experience building and testing pipelines using Apache Airflow, Apache Kafka, and Apache Spark / PySpark
- Expertise with Apache Iceberg and Apache Parquet data formats
- Experience with AWS S3, including data lakes, bucket partitioning, and lifecycle policies
- Ability to define testing strategies and independently debug complex distributed data pipelines
- Strong communication skills and ability to work independently in a fast-paced environment
- Ability to demonstrate good connectivity to an AWS WorkSpace region by completing the required connectivity test
- Required English for interviews, documentation, and daily communication
- Ability to overlap until at least 12:00 PM Pacific Time
Benefits
Comp & perks- Fully remote work arrangement
- Full-time, permanent employment
- Client-provisioned AWS WorkSpace
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data MigrationSQL OptimizationPython DevelopmentApache SparkApache IcebergApache ParquetDAG ManagementTesting StrategiesData Quality AssuranceQuery Tuning
Soft Skills
Strong CommunicationIndependent WorkFast-Paced Adaptability
Tools & Technologies
SnowflakeApache AirflowApache KafkaAWS S3Snowpark Connect
Industry Keywords
Data EngineeringData PipelineCloud RegionsData LakesLifecycle Policies