FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Proficient in Databricks and Apache Spark, with extensive experience in data engineering and ETL processes, particularly in Bronze/Silver/Gold architecture. Demonstrates strong execution skills and the ability to collaborate effectively across teams in a fast-paced environment.
Highest-signal resume keywords
Databricks ProficiencyApache Spark KnowledgeData Engineering/ETL ExperienceData Quality Framework ImplementationAWS Cloud Familiarity
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline OrchestrationBronze/Silver/Gold ArchitectureData Quality ProcessesWorkflow DevelopmentData Distribution Channels
Soft Skills
AutonomyStrong Execution SkillsCollaboration
Tools & Technologies
AWS S3DynamoDBTerraformDatabricks Asset Bundles
Industry Keywords
Data LifecycleData ProductsAutomated OrchestrationFast-Paced Environment
Tech Stack
Tools & technologiesApacheAWSCloudDynamoDBETLSparkTerraform
About the role
Key responsibilities & impact- Work across the full data lifecycle: ingestion into the Lake/S3, Bronze, Silver, and Gold layers, feature store, distribution layer, and delivery to the customer
- Replace manual orchestration with native, automated Databricks orchestration
- Implement data quality processes across all pipeline layers, from the Lake through final delivery
- Develop and parameterize existing workflows
- Contribute to the billing engine for product data usage
- Contribute to the archiving engine by standardizing file distribution through multiple channels, such as buckets, SFTP, and Connect
- Work on a project to structure and accelerate the data platform, which operates more than 700 Databricks pipelines
- Collaborate with platform, product/digital channel squads, and internal engineering teams
Requirements
What you’ll need- Proficiency in Databricks; this is the project’s core requirement
- Knowledge of Apache Spark
- Experience in data engineering/ETL, with strong command of Bronze/Silver/Gold architecture
- Experience orchestrating data pipelines
- Experience implementing data quality frameworks/processes in production pipelines
- Familiarity with the AWS cloud environment, including S3 and DynamoDB
- Terraform is a plus
- Databricks Asset Bundles (DAB) is a plus
- Experience distributing data through multiple channels, such as SFTP, buckets, and APIs, is a plus
- Experience with data products/data as a monetizable product is a plus
- Autonomy and strong execution skills
- Ability to quickly onboard in documented, structured environments
- Comfortable working in a fast-paced environment
- Ability to collaborate across squads
Benefits
Comp & perks- Medical and dental insurance
- Food and meal allowance
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit Sharing and Results (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical and mental health and well-being
- Pregnancy and responsible parenting course
- Partnerships with online course platforms
- Language-learning platform
- Support and accommodations for people with disabilities throughout the selection process
- Dedicated Health and Well-being team, inclusion specialists, and affinity groups