Senior Consultant/Manager – Data Engineer

Electric Mind

. Build and maintain data pipelines on Databricks for a financial services/wealth management data platform .

Posted 11/5/2026full-timeToronto • CanadaSenior💰 CA$110,000 - CA$160,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Proficient in building and maintaining data pipelines using Databricks and PySpark, with strong SQL skills for data validation and debugging. Capable of collaborating in a team environment while ensuring technical documentation is up-to-date.

Highest-signal resume keywords

DatabricksPySparkSQLGitData Pipeline Development

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonSQLData Pipeline DevelopmentUnit TestingIntegration TestingDebuggingData Quality AssuranceChange Data CaptureEvent Log AnalysisSchema Drift Management

Soft Skills

CollaborationAttention to DetailProblem SolvingCode Review

Tools & Technologies

DatabricksUnity CatalogGitLabPowerShell

Industry Keywords

Financial ServicesWealth ManagementData PlatformData ModelsCustomer DataAccount DataTransaction Data

Tech Stack

Tools & technologies

ApachePySparkPythonSparkSQLUnity

About the role

Key responsibilities & impact

Build and maintain data pipelines on Databricks for a financial services/wealth management data platform
Write and maintain hand-written PySpark transforms for silver and gold layer tables, including customer, account, and transaction data models
Work with Lakeflow Declarative Pipelines and Auto CDC / SCD Type 2 patterns for change-data-capture merges
Query and validate data in Unity Catalog across dev/qa/uat using SQL warehouses
Debug failed pipeline runs by reading event logs, tracing bad records, and fixing schema drift or data quality issues
Maintain reference/lookup tables and PowerShell/Python utility scripts
Write and update unit/integration tests for transform logic
Participate in GitLab code reviews using feature branches and merge requests
Keep technical documentation current
Work alongside a senior engineer and help maintain healthy Databricks environments

Requirements

What you’ll need

Python — comfortable writing clean, readable code; understands functions, modules, basic OOP
Databricks
Some exposure to Apache Spark / PySpark, or strong SQL skills plus a willingness to learn Spark quickly
Working knowledge of SQL (joins, aggregations, window functions)
Basic Git workflow: branches, commits, pull/merge requests
Comfortable reading other people's code and stack traces, and debugging methodically (not guess-and-check)