FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Data Engineer II
The Walt Disney Company. Design, craft, and own high-quality foundational datasets for machine learning models and subscriber experiences .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and optimizing large-scale data processing pipelines and datasets for machine learning applications, with a strong foundation in programming and cloud technologies. Proficient in data quality enhancement and collaboration across multidisciplinary teams to support critical data operations.
Highest-signal resume keywords
Python ProgrammingData Pipeline DevelopmentDatabricks ExperiencePublic Cloud ProficiencyDistributed Data Processing
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data StructuresAlgorithmsDesign PatternsData Quality ChecksExploratory Data AnalysisAnomaly DetectionCI/CD PipelinesNoSQL Data StoresRecommendation SystemsMachine Learning Models
Soft Skills
Strong Communication Skills
Tools & Technologies
DatabricksApache SparkAWSMicrosoft AzureGoogle CloudKafkaKinesisSQS
Certifications & Qualifications
Bachelor’s Degree in Computer Science
Industry Keywords
Large Scale Data WorkloadsData Processing JobsSubscriber ExperiencesObservability Best Practices
Tech Stack
Tools & technologiesApacheAWSAzureCassandraCloudDynamoDBJavaKafkaNoSQLPythonSpark
About the role
Key responsibilities & impact- Design, craft, and own high-quality foundational datasets for machine learning models and subscriber experiences
- Source, analyze, and validate diverse upstream data sources and raw signals using exploratory data analysis
- Identify and build new user and content data features for recommendation systems
- Enhance existing feature quality through experimentation, analysis, and iterative development
- Build, optimize, and maintain large-scale data processing jobs, pipelines, and workloads
- Improve data quality and reliability through checks, anomaly detection, testing, monitoring, and alerting
- Follow observability best practices and participate in an on-call rotation supporting critical production data pipelines
- Collaborate with machine learning engineers, data engineers, software engineers, project managers, and product managers
Requirements
What you’ll need- Bachelor’s degree in Computer Science (or related field), or equivalent work experience
- 3 years of experience working with large scale data workloads, building and curating datasets and developing data pipelines and processing jobs
- Strong programming skills in Python, Java, or comparable object-oriented language
- Experience working with Databricks or equivalent large-scale data processing platforms
- Demonstrated knowledge of operating within a Public Cloud Provider (e.g. AWS, Microsoft Azure, Google Cloud)
- Experience working with source control systems and CI/CD pipelines
- Strong grasp of computer science fundamentals (data structures, algorithms, design patterns, etc.)
- Strong communication skills, both written and verbal
- Preferred: Proficiency working in Databricks to build data pipelines
- Preferred: Experience with distributed data processing frameworks, such as Apache Spark
- Preferred: Demonstrated knowledge of messaging technologies (e.g. Kafka, Kinesis, SQS, or other)
- Preferred: Familiarity with recommendation systems industry architectures and best practices
- Preferred: Hands-on experience with NoSQL data stores (e.g. DynamoDB, Cassandra, ScyllaDB, or other)
- Preferred: Hands-on experience using AI and coding assistants to accelerate design and development
Benefits
Comp & perks- Medical, financial, and/or other benefits
- Bonus and/or long-term incentive units may be provided as part of the compensation package