Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Object Edge

Senior Data Engineer, Databricks

Object Edge

. Provide technical leadership with minimal oversight to deliver innovative solutions on the Databricks Platform .

Posted 11/5/2026full-timeRemote • BrazilSeniorWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing data solutions on the Databricks platform, utilizing cloud data lakehouse methodologies and ensuring data quality and pipeline efficiency. Proficient in building scalable data pipelines and collaborating with cross-functional teams to optimize data workflows.

Highest-signal resume keywords
Databricks Platform ExpertiseData Pipeline Design and DevelopmentDelta Lake and Delta Live TablesApache Spark ProficiencyDatabricks Data Engineering Certification

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Data Pipeline DesignYAML ConfigurationSQL ProgrammingObject-Oriented ProgrammingBatch and Streaming Data ProcessingJob/Workflow OrchestrationData Quality SolutionsNoSQL Database FamiliarityInfrastructure as CodeAI/ML Tools Exposure
Tools & Technologies
DatabricksDelta LakeAuto LoaderAirflowDbtGreat ExpectationsCollibraAmazon EMRAmazon RedshiftSnowflake
Certifications & Qualifications
Databricks Data Engineering Associate CertificationDatabricks Data Engineering Professional Certification
Industry Keywords
Cloud Data LakehouseDistributed Processing EnginesEvent Streaming PlatformsData and AnalyticsData QualityPipeline AuditObservability SolutionsCI/CD PipelinesContainer Management SystemsModern Data Technologies

Tech Stack

Tools & technologies
AirflowAmazon RedshiftApacheBigQueryCloudJavaNoSQLPySparkPythonSnowflakeSparkSQLTerraformUnity

About the role

Key responsibilities & impact
  • Provide technical leadership with minimal oversight to deliver innovative solutions on the Databricks Platform
  • Use cloud data lakehouse methodologies, distributed processing engines, event streaming platforms, and modern data technologies
  • Participate in the Databricks Center of Excellence
  • Build next-generation data platforms for organizations in data and analytics
  • Work under the direction of a Solution Architect to design and implement components of client data platform solutions
  • Participate in design sessions, break down complex development tasks, and complete development items on time
  • Contribute to Center of Excellence initiatives by developing Databricks solution accelerators
  • Develop and implement data solutions using Databricks and its platform features
  • Collaborate with cross-functional teams to design and optimize batch and streaming data pipelines
  • Ensure data quality and pipeline efficiency
  • Stay current with emerging technologies and Databricks platform features and continuously improve relevant skills

Requirements

What you’ll need
  • At least 2 years of hands-on data pipeline design and development experience with Databricks
  • Experience with Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog
  • Proficiency designing and building robust, scalable, YAML configuration-driven data pipelines
  • Experience with batch, micro-batch, and streaming data ingestion and processing patterns using tools such as Auto Loader
  • Experience building complex job/workflow orchestration patterns using Databricks Jobs/Workflows or tools such as Airflow and dbt
  • Exposure to data quality, pipeline audit, and observability solutions using Databricks-native features or tools/frameworks such as Great Expectations, Collibra, and dbt
  • Proficiency with Apache Spark, Presto, and Amazon EMR
  • Experience with Amazon Redshift, Snowflake, and Google BigQuery
  • Strong programming skills using SQL, stored procedures, and object-oriented programming languages such as Java, Python, and PySpark
  • Familiarity with DevOps and CI/CD pipelines using Databricks Asset Bundles, automated validation, and testing
  • Exposure to Infrastructure as Code tools such as Terraform is a plus
  • Familiarity with NoSQL databases and container management systems
  • Exposure to AI/ML tools such as MLflow, prompt engineering, and modern data and AI agentic workflows
  • Databricks Data Engineering Associate and/or Professional certification and multiple Databricks project delivery experience are ideal

Benefits

Comp & perks
  • Equal employment opportunity and nondiscrimination protections
  • Work environment free of unlawful discrimination and harassment