Senior Data Engineer

Beyond Soluções

. Develop applications and data pipelines with Python .

Posted 10/3/2026contractRemote • BrazilSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing applications and data pipelines using Python and PySpark, with a strong focus on performance and maintainability. Proficient in orchestrating data workflows with Airflow and implementing Data Lakehouse and Medallion Architecture patterns.

Highest-signal resume keywords

Python Application DevelopmentPySpark Distributed ProcessingAdvanced SQL ProficiencyDbt Data TransformationsAWS Services Knowledge

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonPySparkSQLDbtAirflowETL ProcessesELT ProcessesApache IcebergData Lakehouse ArchitectureMedallion Architecture

Tools & Technologies

GitHubAWS LambdaAWS CloudWatchAWS S3AWS RedshiftAWS Aurora

Industry Keywords

Data PipelinesData TransformationsPipeline OrchestrationCI/CD IntegrationFinancial Platform Development

Tech Stack

Tools & technologies

AirflowAmazon RedshiftApacheAWSETLKafkaPySparkPythonSQL

About the role

Key responsibilities & impact

Develop applications and data pipelines with Python
Process large volumes of data in a distributed environment using PySpark
Build and govern data transformations using dbt
Orchestrate pipelines with Airflow
Use GitHub for version control, pull requests, code reviews, and CI/CD integration
Work with AWS services, including Lambda, CloudWatch, S3, Redshift, and Aurora
Implement and work with Apache Iceberg
Apply Data Lakehouse and Medallion Architecture patterns
Execute ETL/ELT processes
Contribute to building an innovative financial platform from the ground up, with no technical legacy

Requirements

What you’ll need

Strong experience with Python, developing applications and data pipelines with a focus on performance, maintainability, and best practices
Experience with PySpark for distributed processing of large volumes of data
Advanced SQL proficiency
Experience with dbt for building and governing data transformations
Knowledge of Airflow for pipeline orchestration
Strong experience with GitHub, including version control, pull requests, code reviews, and CI/CD pipeline integration
Knowledge of AWS, especially Lambda, CloudWatch, S3, Redshift, and Aurora
Experience with Apache Iceberg
Knowledge of Data Lakehouse architecture and Medallion Architecture
Experience with ETL/ELT processes
Nice to have: experience with Databricks
Nice to have: knowledge of Kafka, particularly in building producers and event-driven messaging systems

Benefits

Comp & perks

End-to-end professional growth opportunities
Healthy work environments
Real-world, high-impact projects
An environment that fosters innovation, technical ownership, and autonomy
The opportunity to build a platform from the ground up, with no technical legacy
Use of best-in-class tools, best practices, and innovative ideas