Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
KeyrusCloud

Senior Data Consultant – Databricks

KeyrusCloud

. Develop, maintain, and optimize Databricks data pipelines and transformations using Python, PySpark, SQL, and notebooks.

Posted 11/4/2026full-timeRemote • New York • United StatesSenior💰 $110,000 - $130,000 per yearWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and optimizing Databricks data pipelines using Python, PySpark, and SQL, while ensuring data quality and performance in modern lakehouse architectures. Proven ability to collaborate with stakeholders and own technical deliverables in analytics environments.

Highest-signal resume keywords
Databricks DevelopmentPython ProgrammingPySpark DevelopmentSQL OptimizationLakehouse Architecture

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Data EngineeringData TransformationPipeline OrchestrationQA ValidationGap AnalysisIncident ResolutionData Quality TroubleshootingData ModelingData VisualizationAI-Assisted Workflows
Soft Skills
CollaborationStakeholder EngagementOwnership
Tools & Technologies
Power BIAzure DevOpsCI/CD PracticesVersion Control
Industry Keywords
Modern Lakehouse ArchitectureMedallion ArchitectureDistributed Data EnvironmentsAnalytics Environments

Tech Stack

Tools & technologies
AzurePySparkPythonSQL

About the role

Key responsibilities & impact
  • Develop, maintain, and optimize Databricks data pipelines and transformations using Python, PySpark, SQL, and notebooks.
  • Support modern lakehouse and medallion architectures (Bronze, Silver, Gold), ensuring reliable processing of structured and semi-structured data.
  • Troubleshoot data quality, pipeline performance, and production issues across analytics environments.
  • Perform QA validation and gap analysis to identify discrepancies between business requirements and delivered data solutions.
  • Support the development, maintenance, and optimization of Power BI dashboards, reports, and data models when required.
  • Collaborate with business stakeholders and technical teams to translate requirements into scalable data and analytics solutions.
  • Own technical deliverables end-to-end with minimal oversight, supporting enhancements, incident resolution, and continuous improvement.
  • Contribute to documentation, technical standards, and emerging AI-assisted workflows, including MCP server-based reporting and agentic data engineering practices.

Requirements

What you’ll need
  • 5+ years of professional experience in data engineering, data consulting, or related data and analytics roles.
  • 3+ years of hands-on experience developing, maintaining, and optimizing Databricks pipelines and data transformations.
  • Proven experience working with modern lakehouse architectures, distributed data environments, and pipeline orchestration.
  • Experience supporting production analytics environments, including QA validation, gap analysis, and incident resolution.
  • Experience collaborating with business stakeholders and technical teams, with ownership of technical deliverables.
  • Exposure to business intelligence and reporting solutions, preferably Power BI.
  • Strong Databricks development experience using PySpark, Python, SQL, and notebooks.
  • Advanced SQL skills, including data transformations, optimization, and troubleshooting.
  • Lakehouse and medallion architecture principles (Bronze, Silver, Gold).
  • Azure DevOps, CI/CD practices, version control, and development workflows.
  • Experience with distributed data environments, pipeline orchestration, and production data support.
  • Familiarity with reporting and data visualization tools, preferably Power BI.
  • Exposure to AI-assisted development and agentic data engineering workflows.

Benefits

Comp & perks
  • Health insurance for you and your family members
  • 401K plan
  • Monthly Wellness Allowance
  • 4 weeks of paid vacation
  • Language courses (French & English)
  • Access to continuing education (in-house, conferences, events, courses, certifications, etc.)
  • Regular social events, from happy hours to trivia nights