FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in data engineering, ETL/ELT development, and cloud technologies, with a strong focus on Databricks and Apache Spark. Proficient in data modeling, data governance, and implementing security controls within cloud-native environments.
Highest-signal resume keywords
Databricks ExpertiseETL/ELT DevelopmentApache Spark / PySparkData Governance FrameworksCloud Technologies (Azure)
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data EngineeringSQLPythonData ModelingData WarehousingStreaming ProcessingDelta LakeData QualityCI/CD PipelinesInfrastructure Automation
Tools & Technologies
Databricks Lakehouse PlatformUnity CatalogTerraformGitHub ActionsAzure DevOps
Certifications & Qualifications
Bachelor's Degree
Industry Keywords
Big Data ProcessingData LineageRow-Level SecurityAccess ControlCompliance
Tech Stack
Tools & technologiesApacheAWSAzureCloudETLGoogle Cloud PlatformPySparkPythonSparkSQLTerraformUnity
About the role
Key responsibilities & impact- Design, develop, and maintain data pipelines using Databricks, Apache Spark, and cloud-native services
- Build and optimize ETL/ELT workflows for large-scale structured and unstructured data
- Develop data models and implement data quality, validation, and governance frameworks
- Integrate data from multiple sources into a unified Lakehouse architecture
- Optimize Spark jobs and Databricks workloads for performance, scalability, and cost efficiency
- Implement security controls, access management, and data governance using Unity Catalog
- Collaborate with business, analytics, and AI/ML teams to deliver trusted data products
- Monitor, troubleshoot, and resolve data pipeline issues
- Support CI/CD, DevOps, and infrastructure automation practices
- Maintain technical documentation and best practices
Requirements
What you’ll need- Minimum of 5+ years of hands-on experience in Databricks
- Bachelor's Degree
- Expertise in data engineering, ETL/ELT development, cloud technologies preferably Azure, and big data processing
- Experience with Databricks Lakehouse Platform
- Experience with Apache Spark / PySpark
- Experience with Delta Lake
- Proficiency in SQL
- Proficiency in Python
- Experience with data modeling and data warehousing
- Knowledge of data quality and validation
- Knowledge of streaming and real-time processing
- Knowledge of Unity Catalog, data lineage, row-level security, access control, compliance, and data governance frameworks
- Experience with Azure, AWS, or GCP
- Experience with Terraform
- Experience with GitHub Actions or Azure DevOps
- Knowledge of CI/CD pipelines
- Knowledge of semantic layers, data products, BI platforms, machine learning support, and generative AI/RAG architectures