FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and enhancing Data Engineering solutions using Databricks, with a strong focus on developing scalable data pipelines and implementing the Medallion model. Proficient in data ingestion, transformation, and delivery processes utilizing PySpark and Apache Spark.
Highest-signal resume keywords
PySpark ProficiencyApache Spark ExperienceData Lakehouse Architecture KnowledgeDatabricks Platform Migration ExperienceDelta Lake Expertise
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
SQLData Pipeline DevelopmentData IngestionData TransformationData Delivery ProcessesPipeline OrchestrationMonitoringGitCI/CDNoSQL Databases
Tools & Technologies
DatabricksDelta TablesUnity CatalogLakeflowAirflowKafkaDbtAWS GlueBigQueryLakeflow Connect
Certifications & Qualifications
Databricks Certified Data Engineer Associate
Industry Keywords
Medallion ModelBronzeSilverGoldAccounting ProjectsFinancial Projects
Tech Stack
Tools & technologiesAirflowApacheAWSBigQueryCassandraKafkaMongoDBNoSQLPostgresPySparkSparkSQLUnity
About the role
Key responsibilities & impact- Build, migrate, and enhance Data Engineering solutions in Databricks environments
- Develop and maintain scalable, reliable, and high-performance data pipelines
- Implement data ingestion, transformation, and delivery processes using Spark and PySpark
- Work with Data Lake and Data Lakehouse architectures, implementing the Medallion model (Bronze, Silver, and Gold)
- Interpret business rules and translate them into data processes and solutions
- Participate in data platform migration and modernization projects
- Ensure pipeline quality, performance, monitoring, and reliability
Requirements
What you’ll need- Proficiency in PySpark, Apache Spark, and SQL
- Experience with Delta Lake, Delta Tables, Unity Catalog, and Lakeflow Declarative Pipelines
- Knowledge of Lakeflow Connect for data ingestion
- Experience with Jobs, Workflows, pipeline orchestration, and monitoring
- Experience with Lakehouse architecture and the Medallion model (Bronze, Silver, and Gold)
- Experience migrating platforms or developing projects in Databricks
- Knowledge of Git, CI/CD, and development and deployment best practices
- Knowledge of Airflow, Kafka, dbt, AWS Glue, and BigQuery
- Experience with SQL/NoSQL databases such as PostgreSQL, MongoDB, or Cassandra
- Preferred: experience with accounting and financial projects
- Preferred: Databricks Certified Data Engineer Associate certification
Benefits
Comp & perks- Remote work
- This position is also open to candidates with disabilities