Senior Data Engineer – Azure Databricks

Applaudo

. Design, build, and maintain production-grade data pipelines using Azure Databricks and Python .

Posted 10/22/2026part-timeRemote • Costa RicaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining data pipelines using Azure Databricks and Python, with a strong focus on data transformation, quality validation, and integration from various sources. Proficient in SQL and data warehousing concepts, ensuring reliable data solutions through effective collaboration and communication.

Highest-signal resume keywords

Azure DatabricksPython Data ProcessingApache Spark (PySpark/Spark SQL)SQL ProficiencyData Warehousing and Dimensional Modeling

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Pipeline DevelopmentData TransformationSQL TransformationsData Quality ValidationData IntegrationDimensional ModelingData Mart DevelopmentAPI Data IngestionTroubleshooting Pipeline IssuesDocumentation Standards

Soft Skills

Effective CollaborationStrong Communication SkillsAutonomous WorkOwnership

Tools & Technologies

Azure Data ServicesCloud StorageSFTPCRM SystemsTicketing SystemsMarketing PlatformsRelational Databases

Industry Keywords

Data EngineeringData Quality ChecksData DiscrepanciesData SolutionsEnterprise Platforms

Tech Stack

Tools & technologies

ApacheAzureCloudPySparkPythonSparkSQL

About the role

Key responsibilities & impact

Design, build, and maintain production-grade data pipelines using Azure Databricks and Python
Develop scalable data transformations using PySpark or Spark SQL
Ingest and process data from APIs, relational databases, cloud storage, and SFTP sources
Integrate data from ticketing, CRM, marketing, retail, and other enterprise platforms into a centralized Data Hub
Develop and maintain data warehouse structures, dimensional models, and data marts
Write, optimize, and maintain SQL transformations
Implement data quality validations and consistency checks
Build and maintain outbound data feeds for third-party systems
Investigate data discrepancies and troubleshoot pipeline issues
Document data pipelines, transformation logic, dependencies, and technical processes
Collaborate with team members and stakeholders to clarify requirements, identify risks, and deliver reliable data solutions
Communicate progress, blockers, and potential delays proactively, proposing next steps

Requirements

What you’ll need

5+ years of professional experience in Data Engineering
Strong hands-on experience with Azure Databricks
Advanced Python skills for data processing, transformation, and pipeline development
Solid experience with Apache Spark, including PySpark and/or Spark SQL
Advanced SQL proficiency, including complex transformations, data validation, and query performance optimization
Strong knowledge of data warehousing and dimensional modeling, including facts, dimensions, and data marts
Experience integrating data from REST APIs, relational databases, cloud storage, and SFTP
Hands-on experience with Microsoft Azure data services
Experience implementing data quality checks and validating consistency between source systems and target data models
Ability to troubleshoot pipeline failures and investigate data discrepancies
Ability to work autonomously, take ownership, and follow engineering practices and documentation standards
Strong English communication skills
Ability to collaborate effectively with a US-based team
Experience migrating SQL-based data workloads to Azure Databricks is nice to have

Benefits

Comp & perks

Employees can work remotely
Opportunity to learn fast and take ownership
Collaboration with strong teams
Investment in modern ways of working
Participation in AI-native transformation at scale