Mid-Level Data Engineer

Stefanini Brasil

. Build and maintain ingestion and transformation pipelines for data from APIs, relational databases, files, and data lakes .

Posted 10/8/2026full-timeRemote • BrazilMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Proficient in building and maintaining data ingestion and transformation pipelines using Python, SQL, and PySpark, with a strong focus on Delta Lake and Medallion architecture. Demonstrates expertise in job orchestration, monitoring, and applying data governance practices.

Highest-signal resume keywords

Python ProgrammingAdvanced SQLPySpark DevelopmentDatabricks ExperienceDelta Lake Knowledge

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Pipeline DevelopmentBatch ProcessingIncremental LoadsMERGE OperationsData Quality RulesJob OrchestrationQuery OptimizationData GovernanceAuto LoaderStructured Streaming

Soft Skills

Problem-SolvingIndependent WorkTechnical Communication

Tools & Technologies

DatabricksGitCI/CDAWSAzureGoogle Cloud

Certifications & Qualifications

Databricks Certified Data Engineer Associate

Industry Keywords

Medallion ArchitectureData LakeData LineageAuditingPermissions

Tech Stack

Tools & technologies

AWSAzureCloudPySparkPythonSQLUnity

About the role

Key responsibilities & impact

Build and maintain ingestion and transformation pipelines for data from APIs, relational databases, files, and data lakes
Develop solutions in Python, SQL, and PySpark using organized, reusable, and testable code
Model data in Delta Lake, applying incremental loads, MERGE operations, and maintenance best practices
Implement Medallion architectures (Bronze, Silver, and Gold) and data quality rules
Orchestrate jobs and pipelines, configuring dependencies, parameters, retries, and alerts
Monitor executions, investigate failures, and diagnose data quality and performance issues
Optimize queries, processing, cluster utilization, and costs, measuring the results of improvements
Apply governance and security practices, including access control and sensitive data protection
Collaborate on code reviews, testing, version control, and deployments across environments

Requirements

What you’ll need

Hands-on experience with Python, advanced SQL, and PySpark
Experience building and operating data pipelines in Databricks
Knowledge of Delta Lake, including transactions, schema evolution, incremental loads, and update operations
Experience with batch processing; knowledge of streaming is a plus
Knowledge of Medallion architecture and formats such as CSV, JSON, and Parquet
Experience with job orchestration, monitoring, and failure handling
Familiarity with Git, code reviews, and testing
Ability to investigate issues, explain technical decisions, and work independently
Experience with Auto Loader, Structured Streaming, and declarative pipelines
Knowledge of Unity Catalog, data lineage, auditing, and permissions
Experience with AWS, Azure, or Google Cloud
Experience with CI/CD, infrastructure as code, and Databricks Asset Bundles or equivalent tools
Databricks Certified Data Engineer Associate certification

Benefits

Comp & perks

Meal allowance or food voucher
Discounts on courses, universities, and language institutions
Stefanini Academy — a platform offering free, up-to-date online courses with certificates
Mentoring
Benefits club offering discounts on medical consultations and examinations
Health insurance
Dental insurance
Benefits and discounts at leading establishments
Travel club
Pet care benefits