FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Expertise in defining end-to-end architecture for data products, including ingestion, transformation, and governance on cloud platforms. Proficient in designing scalable data pipelines and ensuring data quality and security while mentoring teams in best practices.
Highest-signal resume keywords
Data EngineeringData ArchitectureDatabricksApache SparkAzure Data Services
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data ModelingSQLPythonScalaCI/CD PipelinesDevOps PracticesAgile MethodologiesData GovernanceData SecurityFeature Engineering
Soft Skills
MentoringTechnical GuidanceCollaboration
Tools & Technologies
DatabricksApache SparkDelta LakeAzureAWSGCP
Industry Keywords
Data ProductsCloud Data PlatformsBatch PipelinesStreaming PipelinesMetadata Management
Tech Stack
Tools & technologiesApacheAWSAzureCloudGoogle Cloud PlatformPythonScalaSparkSQL
About the role
Key responsibilities & impact- Define end-to-end architecture for data products, including ingestion, transformation, storage, governance, and delivery on cloud data platforms
- Partner with product owners and business stakeholders to translate requirements into data models, technical designs, and delivery roadmaps
- Design and oversee scalable batch and streaming pipelines using Databricks, Spark, and Azure data services
- Design AI-ready data products and platform capabilities supporting machine learning and generative AI use cases, including feature engineering, vector search, and RAG pipelines
- Establish standards for data quality, security, access control, lineage, and metadata management
- Lead platform modernization and migration initiatives
- Conduct architecture and design reviews and drive engineering best practices, automation, and release quality controls
- Mentor data engineers and provide technical guidance to cross-functional and vendor teams
Requirements
What you’ll need- 8+ years of experience in data engineering, data architecture, or software development
- 5+ years of experience designing and building data platforms or data products at enterprise scale
- 4+ years of experience with Databricks, Apache Spark, and Delta Lake or similar lakehouse technologies
- 4+ years of experience with Azure, AWS, or GCP data services
- 4+ years of experience with SQL, Python or Scala, and data modeling (dimensional, relational, and lakehouse)
- 3+ years of experience with data governance, security, and access control practices
- 3+ years of experience with CI/CD pipelines, DevOps practices, and Agile methodologies
- Bachelor’s degree in data science, Computer Science, Engineering, Mathematics or an equivalent combination of education, work, and/or military experience
- Must currently possess valid and unrestricted U.S. work authorization
- Candidates requiring sponsorship now or in the future will not be considered
Benefits
Comp & perks- Annual incentive opportunity, potentially delivered as a mix of cash bonus and equity awards
- Approximately 10% travel off-site or to other office locations
