FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and implementing scalable data architectures, optimizing data pipelines, and ensuring data quality and governance. Proficient in leveraging Databricks and AWS for data engineering solutions, with a strong foundation in SQL and Python.
Highest-signal resume keywords
Data EngineeringETL/ELT Pipeline DevelopmentDatabricksAWS EcosystemData Governance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
SQLPythonData LakesData WarehousesSparkPySparkDelta LakeUnity CatalogData QualityData Ingestion
Tools & Technologies
DatabricksAWSAPIsMessaging SystemsCI/CDTerraformDataOps
Certifications & Qualifications
Databricks Certified Data Engineer AssociateDatabricks Certified Data Engineer ProfessionalAWS Certified Data Engineer AssociateAWS Certified Solutions Architect
Industry Keywords
Insurance IndustryData GovernanceData QualityEvent-Driven ArchitecturesMedallion Architecture
Tech Stack
Tools & technologiesAWSETLNoSQLPySparkPythonSparkSQLTerraformUnity
About the role
Key responsibilities & impact- Define and evolve scalable, resilient, and efficient data architectures for analytics platforms and strategic projects.
- Establish technical standards, best practices, and data engineering guidelines across the information lifecycle.
- Design and implement data pipelines across the Bronze, Silver, and Gold layers, ensuring data quality, governance, and traceability.
- Develop and optimize data ingestion, transformation, and delivery processes in Databricks and AWS environments.
- Create and maintain connectors and integrations with various data sources, including APIs, relational databases, NoSQL systems, and enterprise applications.
- Develop reusable solutions, frameworks, and automations to increase productivity and standardize the data ecosystem.
- Implement data quality controls and frameworks, ensuring the consistency, integrity, completeness, and compliance of information.
- Monitor and optimize the performance of pipelines, queries, and distributed processing environments.
- Identify and resolve failures, bottlenecks, and structural issues in production environments.
- Establish and evolve processes for cataloging, governance, lineage, and access control for data assets.
- Evaluate new technologies, tools, and architectural approaches to continuously evolve the data platform.
- Serve as a technical reference for multidisciplinary teams, sharing knowledge and advancing data engineering practices.
Requirements
What you’ll need- Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, Data Engineering, Software Engineering, Statistics, Mathematics, or a related field.
- Solid experience in data engineering and ETL/ELT pipeline development.
- Experience with Databricks and the AWS ecosystem.
- Advanced SQL skills.
- Advanced Python skills.
- Experience with Data Lakes, Data Warehouses, and medallion architecture (Bronze, Silver, and Gold).
- Experience optimizing performance and monitoring and observing data pipelines.
- Knowledge of data governance and data quality.
- Experience with Spark, PySpark, Delta Lake, and Unity Catalog.
- Experience integrating data through APIs and messaging systems.
- Experience in the insurance industry is a plus.
- Databricks Certified Data Engineer Associate or Professional certifications are a plus.
- AWS Certified Data Engineer Associate or AWS Certified Solutions Architect certifications are a plus.
- Knowledge of DataOps is a plus.
- Experience with CI/CD for data pipelines is a plus.
- Knowledge of Infrastructure as Code (Terraform) is a plus.
- Experience with data streaming and event-driven architectures is a plus.
Benefits
Comp & perks- Health Insurance
- Dental Insurance
- Funeral Insurance
- Transportation Allowance
- Meal Voucher
- Food Allowance
- 13th Food Allowance
- Group Life Insurance
- Private Pension Plan
- Childcare and/or Babysitter Allowance
- Profit Sharing and Results-Based Bonus (PLR)
- Wellhub
- Birthday Day Off
- Desenvolve Program with more than 500 courses
- Integrated Health Program covering mental, social, financial, and physical well-being