FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Proficient in Data Engineering with a focus on developing and maintaining data pipelines, implementing data quality controls, and optimizing performance within cloud environments. Experienced in utilizing tools like Databricks and managing data architectures such as Medallion and Lakehouse.
Highest-signal resume keywords
Data EngineeringPythonSQLDatabricks / SparkETL/ELT Processes
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentData Quality MonitoringIncident InvestigationPerformance OptimizationCI/CD Practices
Soft Skills
Knowledge SharingProblem Solving
Tools & Technologies
DatabricksAzureAWSGCPADLS
Industry Keywords
Medallion ArchitectureLakehouse ArchitectureData IngestionVersion Control
Tech Stack
Tools & technologiesAWSAzureETLGoogle Cloud PlatformPythonSparkSQLUnity
About the role
Key responsibilities & impact- Develop and maintain data pipelines
- Handle incidents, fixes, and improvements
- Implement observability sensors
- Investigate ingestion and processing failures
- Work with Raw, Trusted, Refined, and Analytics layers
- Evolve the Medallion architecture and Unity Catalog
- Work with Databricks, ADLS, and integrations
- Implement data quality and freshness controls
- Support performance and cost improvements
- Document solutions and share knowledge with the team
- Build a reliable, stable, and observable data foundation to support the platform’s growth
- Handle operational demands, investigate and resolve production issues, and reduce recurring incidents
Requirements
What you’ll need- Solid experience in Data Engineering within a production environment
- Proficiency in Python and SQL
- Experience with Databricks / Spark
- Experience with Azure, AWS, or GCP
- Experience building and maintaining ETL/ELT processes and data pipelines
- Knowledge of Lakehouse architecture and Raw, Trusted, Refined/Analytics layers
- Knowledge of Medallion architecture
- Experience ingesting data from APIs, databases, files, and other sources
- Knowledge of data quality, monitoring, and troubleshooting
- Experience optimizing performance and costs
- Ability to investigate incidents and recurring issues
- Knowledge of version control, CI/CD, and engineering best practices
Benefits
Comp & perks- Health and dental insurance
- Meal and food allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit-Sharing and Results Program (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical health, mental health, and well-being
- Pregnancy and responsible parenthood course
- Partnerships with online course platforms
- Language-learning platform
- Support and accommodations for people with disabilities throughout the selection process
- Dedicated Health and Well-being team
- Inclusion specialists and affinity groups