FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and operating data pipelines using Spark, Java, and Python, with a strong focus on data quality, observability, and governance. Proficient in applying software engineering principles and collaborating with data scientists and ML engineers to enhance data platform capabilities.
Highest-signal resume keywords
Java ProficiencyPython ProficiencySpark ExperienceData Engineering ExpertiseMLOps Practices
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignDistributed Data ProcessingETL/ELT Pipeline DesignData ModelingBatch ProcessingStreaming ProcessingData QualityData GovernanceSystem DesignLow-Level Design
Soft Skills
Technical JudgmentMentoringOwnership Mindset
Tools & Technologies
Hadoop/HDFSHiveKafkaAirflowKubernetesCI/CDCloud-Native PracticesGenAI/LLM ToolingMicroservicesAgentic Workflows
Certifications & Qualifications
Bachelor's Degree in Computer ScienceMaster's Degree in Computer Science
Industry Keywords
Big DataData EngineeringBusiness IntelligenceBusiness AnalyticsLakehouse Architectures
Tech Stack
Tools & technologiesAirflowCloudDistributed SystemsETLHadoopHDFSJavaKafkaKubernetesMicroservicesPythonScalaSparkC++Go
About the role
Key responsibilities & impact- Design, build, and operate batch and streaming data pipelines using Spark, Java, and Python at Walmart scale
- Apply software engineering fundamentals including clean architecture, automated testing, CI/CD, and code reviews to data engineering
- Apply system design and low-level design rigor to data and platform problems
- Contribute to services, APIs, and distributed systems supporting data pipelines
- Apply AI, GenAI, and agentic capabilities to data platform problems
- Partner with data scientists and ML engineers on feature pipelines, model-serving data paths, and MLOps infrastructure
- Own data quality, observability, and governance for pipelines and datasets
- Participate in data engineering and platform engineering architecture and design reviews
- Provide technical judgment in design and code reviews, mentor early-career engineers, and improve engineering quality
- Evaluate emerging Big Data, cloud, and AI/agentic technologies for reliability, productivity, and business value
Requirements
What you’ll need- 5+ years of professional software engineering experience with hands-on data engineering at scale
- Strong proficiency in Java and Python
- Strong working knowledge of Spark for distributed data processing
- Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
- Minimum qualification alternatives: Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field; or 5 years' experience in software engineering or related field; or Master's degree in Computer Science and 1 year's experience in software engineering or related field
- 2 years' experience in data engineering, database engineering, business intelligence, or business analytics
- Experience with Spark, Hadoop/HDFS, Hive, Kafka, workflow orchestration such as Airflow, batch and streaming processing, and large-scale data transformation
- Experience with data modeling, ETL/ELT pipeline design, data quality and observability, data governance, and lakehouse architectures
- Hands-on experience integrating model APIs and GenAI/LLM tooling, building or operating agentic workflows, embeddings/vector search, and MLOps practices
- Working literacy in microservices, API design, Kubernetes or equivalent orchestration, CI/CD, and cloud-native practices
- Distributed systems fundamentals, system design, and low-level design skills
- Strong software engineering craftsmanship, including testing strategy, code review standards, design patterns, and system design for high-throughput data systems
- Ability to translate data/business problems into technical execution plans
- Strong ownership mindset and technical judgment
- Additional experience with Go, C++, or Scala is a plus
Benefits
Comp & perks- Incentive awards for performance
- Maternity and parental leave
- PTO
- Health benefits
- Compensation package
- Daily office-based work with flexibility for associates to manage their personal lives