FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Engineer – Databricks, Contractor
Object Edge. Provide technical leadership with minimal oversight to deliver solutions on the Databricks Platform .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and optimizing data platforms using Databricks, including proficiency in Delta Lake, Uniform, and data pipeline orchestration. Strong capability in collaborating with cross-functional teams to deliver scalable data solutions and maintain data quality.
Highest-signal resume keywords
Databricks Platform ExpertiseData Pipeline Design and DevelopmentDelta Lake and Unity Catalog ProficiencyApache Spark and SQL ProgrammingCI/CD and DevOps Familiarity
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignDelta LakeUniform (Iceberg)Delta Live TablesApache SparkSQL ProgrammingPython ProgrammingYAML ConfigurationBatch and Streaming Data ProcessingJob Orchestration
Tools & Technologies
Databricks Jobs/WorkflowsAirflowDbtAuto LoaderGreat ExpectationsCollibraAmazon RedshiftSnowflakeGoogle BigQueryTerraform
Certifications & Qualifications
Databricks Data Engineering Associate CertificationDatabricks Data Engineering Professional Certification
Industry Keywords
Cloud Data LakehouseDistributed Processing EnginesEvent Streaming PlatformsData QualityObservability SolutionsInfrastructure as CodeAI/ML ToolsData and Analytics InitiativesCenter of ExcellenceData Solutions
Tech Stack
Tools & technologiesAirflowAmazon RedshiftApacheBigQueryCloudJavaNoSQLPySparkPythonSnowflakeSparkSQLTerraformUnity
About the role
Key responsibilities & impact- Provide technical leadership with minimal oversight to deliver solutions on the Databricks Platform
- Build data platforms using cloud data lakehouse methodologies, distributed processing engines, event streaming platforms, and modern data technologies
- Participate in the Databricks Center of Excellence
- Work with forward-thinking organizations on data and analytics initiatives
- Work under a Solution Architect to design and implement components of clients’ data platform solutions
- Participate in design sessions, break down complex development tasks, and complete development items on time
- Contribute to Center of Excellence initiatives by developing Databricks solution accelerators
- Develop and implement data solutions using Databricks, including Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog
- Collaborate with cross-functional teams to design and optimize batch and streaming data pipelines for quality and efficiency
- Stay current with emerging technologies and Databricks platform features
Requirements
What you’ll need- At least 2 years of hands-on data pipeline design and development experience with Databricks
- Experience with Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog
- Proficiency designing and building scalable YAML configuration-driven data pipelines
- Experience with batch, micro-batch, and streaming data ingestion and processing patterns using tools such as Auto Loader
- Experience building complex job/workflow orchestration patterns using Databricks Jobs/Workflows, Airflow, dbt, or similar tools
- Exposure to data quality, pipeline audit, and observability solutions using Databricks native features or tools such as Great Expectations, Collibra, and dbt
- Proficiency with Apache Spark, Presto, and Amazon EMR
- Experience with Amazon Redshift, Snowflake, and Google BigQuery
- Strong programming skills in SQL, stored procedures, and object-oriented languages such as Java, Python, and PySpark
- Familiarity with DevOps and CI/CD pipelines using Databricks Asset Bundles, automated validation, and testing
- Exposure to Infrastructure as Code tools such as Terraform is a plus
- Familiarity with NoSQL databases and container management systems
- Exposure to AI/ML tools such as MLflow, prompt engineering, and modern data and AI agentic workflows
- Databricks Data Engineering Associate and/or Professional certification and multiple Databricks project delivery experience are ideal
Benefits
Comp & perks- Salary is commensurate with experience based on department and role
- Equal employment opportunities and a work environment free of unlawful discrimination and harassment