Databricks Engineer

v4c.ai

. Build, optimize, and maintain robust data pipelines using SQL, dbt, and Python .

Posted 10/18/2026contractRemote • CanadaMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expert-level SQL skills and extensive experience in building modular models and custom schema tests in dbt, alongside strong proficiency in Python for data manipulation and automation. Capable of maintaining end-to-end ownership of data pipelines, ensuring high data quality and robust system performance.

Highest-signal resume keywords

Expert-Level SQL SkillsExtensive Experience with dbtProficiency in Python ScriptingExperience with PySpark TransformationsEnd-to-End Pipeline Ownership

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

SQLDbtPythonPySparkData ManipulationAutomated Testing FrameworksData Quality ChecksCI/CD DeploymentPerformance TuningDataFrame API

Soft Skills

Exceptional Communication SkillsSuperior Troubleshooting Skills

Tools & Technologies

Delta LakeLakehouse Technologies

Industry Keywords

Data PipelinesData QualityRoot Cause AnalysisSchema DriftACID Transactions

Tech Stack

Tools & technologies

PySparkPythonSQL

About the role

Key responsibilities & impact

Build, optimize, and maintain robust data pipelines using SQL, dbt, and Python
Implement data-quality checks and automated testing frameworks within dbt to catch anomalies
Monitor production workflows and manage alerts
Debug pipeline failures from root cause through permanent fix
Write efficient PySpark transformations for large-scale datasets in a Lakehouse environment
Translate complex data issues into clear action plans for technical teammates and business stakeholders
Maintain end-to-end production ownership of data platforms, ensuring high data quality and robust system performance

Requirements

What you’ll need

Expert-level SQL skills and extensive hands-on experience building modular models, snapshots, and custom schema tests in dbt
Strong proficiency in writing clean, maintainable Python scripts for data manipulation, automation, and API integrations
Decent, practical experience utilizing PySpark for data transformation and basic performance tuning, including joins and the DataFrame API
Functional understanding of Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations
Exceptional written and spoken communication skills
Superior troubleshooting skills with a methodical approach to identifying root causes and validating fixes
Experience owning pipelines end-to-end, including CI/CD deployment, monitoring, and handling schema drift