Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
The Boston Beer Company

BI Data Engineer II

The Boston Beer Company

. Design, build, test, and support Databricks Lakehouse data pipelines using Spark, Delta Lake, Python, and SQL .

Posted 10/1/2026full-timeBoston • Massachusetts • United StatesMid-LevelSenior💰 $77,000 - $136,000 per yearWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Proficient in designing and building data pipelines using Databricks, Spark, and SQL, with a strong focus on data quality, governance, and performance optimization. Experienced in collaborating with cross-functional teams to deliver scalable data solutions and maintain the Databricks platform.

Highest-signal resume keywords
Databricks Lakehouse DevelopmentSpark SQLPython ProgrammingData Pipeline DesignAzure DevOps

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
SQLPythonDatabricks NotebooksDelta LakePySparkData ValidationPerformance TuningBatch ProcessingRelational Database DevelopmentDimensional Modeling
Soft Skills
CollaborationCommunicationProblem-Solving
Tools & Technologies
Azure DevOpsPower BIJiraConfluenceSSIS
Industry Keywords
Consumer InsightsSupply Chain ProcessesAnalytics FrameworksData GovernanceEnterprise Systems

Tech Stack

Tools & technologies
AzurePySparkPythonSparkSQLSSISUnity

About the role

Key responsibilities & impact
  • Design, build, test, and support Databricks Lakehouse data pipelines using Spark, Delta Lake, Python, and SQL
  • Develop and maintain Databricks notebooks, workflows, jobs, and reusable pipeline components
  • Build and maintain curated datasets and analytics-ready models across bronze, silver, and gold Lakehouse layers
  • Support data ingestion, migration, and integration between Databricks, On-Premise SQL Server, SaaS platforms, and other enterprise systems
  • Partner with analysts, data scientists, business stakeholders, Data Operations, and MDM teams to translate requirements into scalable data solutions
  • Monitor, troubleshoot, and optimize Spark jobs and Databricks workflows for performance, reliability, and cost efficiency
  • Implement data validation, error handling, data quality checks, security practices, and governance standards
  • Maintain, administer, and support the evolution of the Databricks platform
  • Support CI/CD and automated deployment practices using Azure DevOps and Databricks Asset Bundles

Requirements

What you’ll need
  • Bachelor’s degree in Computer Science, a closely related field, or equivalent experience
  • Hands-on experience developing data pipelines in Databricks using notebooks, jobs, workflows, PySpark or Spark SQL, and Delta Lake
  • Strong SQL and Python skills
  • Working knowledge of Lakehouse architecture, Delta tables, medallion-style layers, batch processing, and analytics-ready data modeling
  • Exposure to Databricks platform capabilities such as Unity Catalog, Delta Live Tables, Databricks SQL, job clusters, workflow orchestration, performance tuning, cluster configuration, administration, or resource provisioning
  • Ability to apply data validation, reconciliation, access controls, documentation, and governance practices
  • Exposure to source control and automated deployment practices using Azure DevOps and Databricks Asset Bundles
  • Ability to work effectively with analysts, stakeholders, and cross-functional teams
  • Familiarity with dimensional modeling, semantic layers, and Power BI
  • Experience designing, developing, and supporting relational database pipelines, stored procedures, or SSIS workflows
  • Knowledge of CPG, consumer insights and analytics tools such as Nielsen, supply chain processes, Salesforce, SAP, or other enterprise systems is a plus
  • Experience with Jira and Confluence
  • PowerShell or automation scripting experience is a plus
  • Exposure to AI, machine learning, feature engineering, or analytics frameworks is a plus

Benefits

Comp & perks
  • Discretionary annual bonus based on company and individual performance
  • Generous healthcare on day one
  • Stock purchase plan
  • 401k
  • Tuition reimbursement
  • Fertility/adoption support
  • Free financial coaching
  • Health & wellness program and discounts
  • Professional development & training
  • Free beer!