FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing scalable data architectures and pipelines using PySpark, Scala, and SQL, while ensuring data quality and compliance with LGPD. Proficient in leveraging the Databricks Lakehouse Platform for high-performance data management and analytics.
Highest-signal resume keywords
Databricks Lakehouse PlatformPySpark DevelopmentSQL ProficiencyPerformance OptimizationData Modeling
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentScala ProgrammingPython ProgrammingQuery TuningData IngestionData TransformationData GovernanceData Quality AssuranceTechnical DocumentationData Engineering Frameworks
Soft Skills
CollaborationStrategic ThinkingCommunication
Tools & Technologies
RedshiftGitHubMonitoring MechanismsObservability Tools
Industry Keywords
LGPD ComplianceData EcosystemAnalytical WorkloadsTechnical StandardsData Integrity
Tech Stack
Tools & technologiesAmazon RedshiftPySparkPythonScalaSQL
About the role
Key responsibilities & impact- Advance the corporate data ecosystem, working with the Databricks Lakehouse Platform and Redshift while ensuring high availability, governance, and performance.
- Implement scalable, distributed data architectures for large-scale ingestion, transformation, and consumption.
- Develop data pipelines in PySpark, Scala, and SQL, ensuring efficiency, quality, and traceability.
- Define and promote technical standards, best practices, and data engineering frameworks.
- Collaborate with technology, product, and business teams to integrate systems and analytics layers.
- Manage performance and optimize analytical workloads through advanced tuning and monitoring techniques.
- Ensure data quality, integrity, and security in compliance with Brazil’s LGPD and corporate guidelines.
- Implement and oversee observability and monitoring mechanisms for data and processes.
- Document technical architectures, workflows, and processes.
- Serve as a technical and strategic reference for architecture, performance, and scalability decisions.
Requirements
What you’ll need- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- Proven experience as a Senior Data Engineer.
- Hands-on experience with the Databricks Lakehouse Platform or an equivalent technology.
- Proficiency in Python and SQL for developing and optimizing data pipelines.
- Experience with performance optimization and query tuning.
- Experience with data modeling.
- Familiarity with GitHub.
Benefits
Comp & perks- Dental Plan | Amil Dental
- Health Plan | Bradesco Saúde
- Mental Health Platform
- Telemedicine Platform
- Life Insurance | Prudential
- Pharmacy Benefit
- Gym Allowance
- Birthday Day Off
- Flexible Meal Voucher
- Home Office Allowance
- Childcare Assistance
- Transportation Voucher and Company Shuttle
- Discount Platform (Allya, SwileShop, and Dell)
- Educational Benefits
- Travel Benefits
- Pet Health Plan
- SESC Benefits
- Profit-Sharing Program (PPRL)
