Mid-Level Data Engineer

ClickBus

. Develop, maintain, and enhance batch and streaming data pipelines using Airflow (EKS), EMR/Spark, and dbt .

Posted 10/3/2026full-timeSão Paulo • BrazilMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and maintaining data pipelines using Airflow, Spark, and dbt within a cloud environment, ensuring data quality and performance optimization. Proficient in troubleshooting incidents and implementing improvements to enhance data processing efficiency.

Highest-signal resume keywords

Data Pipeline DevelopmentAirflow (DAG Creation)Spark (PySpark Performance Tuning)Dbt (Modeling and Testing)Advanced SQL

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringData IngestionRoot Cause AnalysisIncremental LoadsAnalytical ModelingPythonGit

Soft Skills

Problem SolvingCollaboration

Tools & Technologies

AWS (S3, Athena, IAM, Glue Catalog)EMRDMS

Industry Keywords

Data LakeData QualityVersion ControlCost Efficiency

Tech Stack

Tools & technologies

AirflowAWSCloudPySparkPythonSparkSQL

About the role

Key responsibilities & impact

Develop, maintain, and enhance batch and streaming data pipelines using Airflow (EKS), EMR/Spark, and dbt
Implement data ingestion via DMS, APIs, files, and events, ensuring proper organization across Data Lake layers
Investigate and resolve data incidents, including DAG failures, processing errors, metric inconsistencies, and schema issues
Conduct root cause analysis (RCA) and propose improvements to prevent recurring failures
Ensure data quality through automated tests, validations, and reconciliations
Develop and optimize Spark and dbt transformations for performance and cost efficiency
Optimize Athena queries and dbt models, reducing processing costs and improving response times
Work with incremental loads (append, overwrite, merge/upsert), ensuring consistency and idempotency
Support the evolution of the current architecture by contributing technical improvements and standardization
Perform code reviews and follow best practices for version control and documentation
Work closely with business teams to ensure delivered data meets functional requirements
Monitor pipeline executions and propose continuous improvements

Requirements

What you’ll need

Solid experience as a Data Engineer in a cloud environment
Practical experience building and maintaining data pipelines in production
Experience troubleshooting and resolving incidents
Experience with analytical modeling (facts and dimensions)
Experience with incremental loads and partitioning
AWS (S3, Athena, IAM, Glue Catalog; EMR is a plus)
Airflow (DAG creation and maintenance)
Spark (PySpark — joins, partitioning, and basic performance tuning)
dbt (modeling, incremental models, and testing)
Advanced SQL
Python
Git

Benefits

Comp & perks

Meal/Food Allowance: BRL 1,100.00/month credited to a Flash card
Home Office Allowance: BRL 149.00/month credited to a Flash card
Flexible Benefits: BRL 200.00/month credited to a Flash card
Busonauta Viajante: BRL 2,000.00/year for purchasing bus tickets through the app or website
Transportation allowance
Parking
SulAmérica health insurance with no copayments or monthly premium
Bradesco dental insurance
Childcare assistance for mothers and fathers
6 months of maternity leave and 30 days of paternity leave
Life insurance
Wellhub and TotalPass
Annual profit-sharing bonus
Birthday day off
Petlove partnership
Pharmacy assistance
Assistance for children with disabilities
Partnerships with educational and leisure institutions