FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and optimizing data pipelines with a focus on low latency and data quality, utilizing tools such as Apache Spark, SQL Server, and Databricks. Proven ability to implement CI/CD processes and conduct root cause analyses in production environments.
Highest-signal resume keywords
Data Engineering ExperienceApache Spark / PySparkSQL ServerCI/CD ProcessesData Lake Migration
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline OptimizationData Workflow DevelopmentRoot Cause AnalysisCost-Optimization StrategiesVersion Control with Git
Tools & Technologies
DatabricksDelta LakeCI/CD ToolsGit
Industry Keywords
Data LakeData WarehouseData GovernanceProduction EnvironmentsAI Projects
Tech Stack
Tools & technologiesApachePySparkSparkSQL
About the role
Key responsibilities & impact- Build, maintain, and optimize robust data pipelines, with a focus on low latency, resilience, data quality, and observability
- Develop scalable data workflows using Apache Spark / PySpark and Databricks
- Apply efficient partitioning and cost-optimization strategies
- Structure and manage data using SQL Server and Delta Lake
- Implement version control with Git
- Create CI/CD processes to automate deployments
- Continuously monitor production workflows
- Investigate failures and perform root cause analyses
- Drive the continuous improvement of production workflows
- Contribute to scalable, product-oriented architectures
- Lead technical initiatives and support the evolution of the data platform
Requirements
What you’ll need- Experience in data engineering
- Experience working in production environments
- Experience handling large volumes of data
- Participation in data lake migration, modernization, or development projects
- Ability to investigate incidents and perform root cause analyses
- Knowledge of Apache Spark / PySpark and Databricks
- Knowledge of SQL Server and Delta Lake
- Experience with Git and CI/CD processes
- Preferred: experience with AI projects and pipeline automation
- Preferred: knowledge of data-oriented architectures and governance best practices
- Preferred: familiarity with Databricks MLflow for model management
- Preferred: experience working in Data Lake and Data Warehouse environments
Benefits
Comp & perks- Health and dental insurance
- Meal and food allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit-Sharing and Results Program (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical health, mental health, and well-being
- Pregnancy and responsible parenting course
- Partnerships with online learning platforms
- Language-learning platform
- Support and accommodations for people with disabilities
- Dedicated Health and Well-being team
- Inclusion specialists and affinity groups