Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
PLATO

Data Engineer – Silver Conversions, Scheduling

PLATO

. Develop Silver-layer conversion and transformation pipelines using Microsoft Fabric, Azure Data Factory, Spark, and Delta Lake .

Posted 10/14/2026full-timeRemote • CanadaMid-LevelSenior💰 CA$82 - CA$95 per hourWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and maintaining data transformation pipelines using Microsoft Fabric, Azure Data Factory, and PySpark, with a strong focus on performance tuning and data integrity. Proficient in pipeline orchestration, error handling, and CI/CD practices to ensure efficient data workflows.

Highest-signal resume keywords
Microsoft FabricPySparkAzure Data FactorySpark SQLDelta Lake

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Data TransformationPipeline OrchestrationError HandlingUnit TestingPerformance Tuning
Tools & Technologies
Azure DevOpsGitCI/CD PipelinesMicrosoft Purview
Certifications & Qualifications
Active Reliability Security ClearanceEligible for Secret Clearance
Industry Keywords
Data IntegrityCheckpointingReplayRecoveryMetadata-Driven Configuration

Tech Stack

Tools & technologies
AzurePySparkSparkSQL

About the role

Key responsibilities & impact
  • Develop Silver-layer conversion and transformation pipelines using Microsoft Fabric, Azure Data Factory, Spark, and Delta Lake
  • Build and maintain scheduling and orchestration of Silver pipelines, including dependencies, retries, and failure handling
  • Use reusable PySpark libraries and metadata-driven configuration to speed delivery
  • Apply standard error handling, logging, monitoring, and unit-testing patterns
  • Support reconciliation, checkpointing, replay, and recovery to maintain data integrity
  • Tune Spark workloads for performance and cost efficiency

Requirements

What you’ll need
  • Minimum 5 years of experience with Microsoft Fabric (Data Factory, Lakehouse), PySpark, Spark SQL, Delta Lake, Azure Data Factory, and Azure Storage
  • Experience with pipeline orchestration and scheduling using Fabric Data Factory / Azure Data Factory
  • Experience with PySpark and Spark SQL data transformation
  • Microsoft Purview exposure for cataloguing and lineage
  • Experience with Azure DevOps, Git, and CI/CD pipelines
  • Active Reliability security clearance
  • Eligible for Secret clearance

Benefits

Comp & perks
  • Collaborative environment
  • Mentorship and coaching
  • Knowledge-sharing opportunities
  • Inclusive hiring practices
  • Accommodation support during the recruitment process