FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Data Engineer, AWS – Databricks
SysMap Solutions. Develop and enhance Data Engineering solutions using Databricks and AWS .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Data Engineering solutions, particularly with Databricks and AWS, while ensuring data quality, security, and governance. Proficient in developing and optimizing data pipelines and implementing access controls using Unity Catalog.
Highest-signal resume keywords
DatabricksUnity CatalogSQLPythonPySpark
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data EngineeringData LineageDelta LakeWorkload OptimizationPerformance TuningData GovernanceData SecurityBatch Data PipelinesStreaming PipelinesAccess Controls
Tools & Technologies
AWSDatabricks WorkflowsLakehouse Architecture
Industry Keywords
Data Asset OrganizationGovernance Best PracticesIdentity and Security Systems
Tech Stack
Tools & technologiesApacheAWSPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Develop and enhance Data Engineering solutions using Databricks and AWS
- Administer and enhance Unity Catalog
- Structure catalogs, schemas, tables, volumes, and other data objects
- Implement and administer access controls and permissions using Unity Catalog
- Support the definition and implementation of data security and governance policies
- Work with Data Lineage, data discovery, and data traceability
- Develop and maintain batch data pipelines and, where applicable, streaming pipelines
- Develop transformations using SQL, Python, and PySpark
- Work with Delta Lake / Delta Tables and Lakehouse architecture
- Integrate data sources using AWS services and Databricks platform components
- Ensure data quality, reliability, security, and availability
- Support the definition of architecture standards and best practices for Databricks usage
- Monitor and optimize data workload performance and costs
- Collaborate with Data Engineering, Data Science, Analytics, Architecture, Security, and Governance teams
Requirements
What you’ll need- Solid experience with Databricks
- Strong hands-on experience with Unity Catalog
- Knowledge of catalogs and schemas
- Knowledge of tables and views
- Knowledge of volumes
- Knowledge of access controls and privileges
- Knowledge of GRANT/REVOKE
- Knowledge of Data Lineage
- Knowledge of data asset organization and governance
- Knowledge of integration with identity and security systems
- Knowledge of governance best practices in corporate environments
- Experience with Delta Lake
- Knowledge of Apache Spark and/or PySpark
- Experience with Databricks Workflows/Jobs
- Knowledge of workload optimization and performance tuning
Benefits
Comp & perks- No specific benefits, additional benefits, or extra compensation were provided.