FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and optimizing data pipelines with a focus on low latency and data quality, utilizing tools such as Apache Spark, Databricks, and SQL Server. Proficient in CI/CD practices and capable of driving continuous improvement in production workflows.
Highest-signal resume keywords
Data Engineering ExperienceApache Spark / PySpark KnowledgeSQL Server ProficiencyCI/CD AutomationRoot Cause Analysis
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentApache SparkPySparkSQL ServerDelta LakeGitCI/CDData Workflow OptimizationRoot Cause AnalysisData Lake Migration
Tools & Technologies
DatabricksGitCI/CDDatabricks MLflow
Industry Keywords
Data EngineeringData LakeData WarehouseData GovernanceProduction Environments
Tech Stack
Tools & technologiesApachePySparkSparkSQL
About the role
Key responsibilities & impact- Build, maintain, and optimize robust data pipelines, with a focus on low latency, resilience, data quality, and observability
- Develop scalable data workflows using Apache Spark / PySpark and Databricks
- Apply efficient partitioning and cost-optimization strategies
- Structure and manage data using SQL Server and Delta Lake
- Apply version control with Git
- Create CI/CD routines to automate deployments
- Continuously monitor production workflows
- Investigate failures and perform root cause analysis
- Drive the continuous improvement of production workflows
- Contribute to scalable, product-oriented architectures
- Lead technical initiatives and support the evolution of the data platform
Requirements
What you’ll need- Experience in data engineering
- Experience working in production environments
- Experience handling large volumes of data
- Participation in data lake migration, modernization, or development projects
- Ability to investigate incidents and perform root cause analysis
- Knowledge of Apache Spark / PySpark
- Knowledge of Databricks
- Knowledge of SQL Server
- Knowledge of Delta Lake
- Experience with Git and CI/CD
- Preferred: experience with AI projects and pipeline automation
- Preferred: knowledge of data-oriented architectures and governance best practices
- Preferred: familiarity with Databricks MLflow for model management
- Preferred: experience working in Data Lake and Data Warehouse environments
Benefits
Comp & perks- Health and dental insurance
- Meal and food allowances
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit-Sharing and Results Program (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical and mental health and well-being
- Pregnancy and responsible parenting course
- Partnerships with online course platforms
- Language-learning platform
- Support obtaining disability documentation for people with disabilities
- Dedicated Health and Well-being team
- Inclusion specialists and affinity groups