FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in data governance, architecture, and engineering, with a strong focus on Databricks Unity Catalog, SQL, and Python. Proven ability to develop and maintain data pipelines, implement data quality checks, and support machine learning workflows in an Agile environment.
Highest-signal resume keywords
Databricks Unity CatalogData GovernanceSQLPythonData Engineering
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Quality ManagementData ModelingETL ProcessesMachine Learning PipelinesDelta LakeReference ArchitecturesData Annotation WorkflowsFeature EngineeringMetadata ManagementAgile Development
Soft Skills
CollaborationPrioritizationCommunication
Tools & Technologies
MLflowMicrosoft FabricDelta SharingAnnotation ToolsVector Databases
Industry Keywords
Data WarehousingDimensional ModelingInformation ArchitectureNLPMetrics and KPIs
Tech Stack
Tools & technologiesETLPythonSQLUnity
About the role
Key responsibilities & impact- Design, implement, and maintain data governance and architecture capabilities using Databricks Unity Catalog
- Implement automated data quality checks, monitoring, and alerts, and coordinate remediation workflows
- Integrate data platforms with Microsoft Fabric and expose trusted Gold-layer data products through enterprise data marketplaces
- Develop and maintain reference architectures, data engineering standards, and technical documentation
- Build data annotation workflows and labeling interfaces in Databricks
- Track annotation progress, data quality, and dataset versions for ML training and inference
- Develop LLM and RAG pipelines, including document ingestion, chunking, embedding generation, and vector search
- Support machine learning pipelines through feature engineering, batch and real-time scoring, and data monitoring
- Maintain MLflow capabilities for experiment tracking and model registry management
- Design and maintain data classification schemas, taxonomies, and labeling specifications
- Own and enhance Gold-layer data products, including experience arrays and friction signal aggregates
- Integrate new data sources, implement business rules, and develop consumption-ready data views and APIs
- Maintain data dictionaries, product documentation, and metadata
- Collaborate with cross-functional teams in an Agile development environment to deliver scalable data solutions
Requirements
What you’ll need- U.S. citizenship is required
- University Degree or equivalent experience and a minimum of 8 years of prior relevant experience, or an Advanced Degree in a related field and a minimum of 5 years of experience
- 5+ years of experience in data engineering or analytics engineering, preferably using Databricks or a similar lakehouse platform
- Experience with SQL, Python, and Delta Lake
- Experience with Unity Catalog, data governance, and data quality management
- Experience building and maintaining data pipelines for machine learning training and inference
- Experience with data modeling, classification schemas, and taxonomies
- Extensive experience with data warehousing concepts, dimensional modeling, and ETL processes
- Experience working in an Agile development environment and managing multiple priorities
- Experience with Microsoft Fabric, Delta Sharing, or cross-platform data sharing preferred
- Familiarity with annotation tools, NLP, and vector databases preferred
- Experience with MLflow or similar tools preferred
- Background in metrics and KPIs, information architecture, or IT and infrastructure domains preferred
Benefits
Comp & perks- Healthcare, wellness, retirement and work/life benefits
- Parental (including paternal) leave
- Flexible work schedules
- Achievement awards
- Educational assistance
- Child/adult backup care
- Medical, dental, and vision insurance
- Life insurance
- Short-term disability
- Long-term disability
- 401(k) match
- Flexible spending accounts
- Employee assistance program
- Employee Scholar Program
- Paid time off and holidays
- Annual short-term and/or long-term incentive compensation programs may be available
