FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and deploying data pipelines and Generative AI applications within the Databricks ecosystem, with a strong focus on cloud-native architectures and technical leadership in enterprise environments.
Highest-signal resume keywords
Data EngineeringDatabricks EcosystemCloud-Native ArchitecturesTechnical LeadershipMachine Learning
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignGenerative AI ApplicationsRAG Pipeline DeploymentModel Fine-TuningML Pipelines ManagementDatabricks Lakehouse ArchitectureSpark/PySparkVector DatabasesLegacy Platform MigrationAnalytics Engine Development
Soft Skills
Exceptional Communication SkillsClient Stakeholder ManagementMentoring
Tools & Technologies
DatabricksAWSS3GlueLambdaRedshiftMLflowUnity CatalogDelta LakeDatabricks Workflows
Certifications & Qualifications
Databricks Certified Data Engineer ProfessionalDatabricks Certified Machine Learning Professional
Industry Keywords
HealthcareRetailConsumer GoodsEnterprise ClientsFortune 500
Tech Stack
Tools & technologiesAmazon RedshiftAWSCloudHadoopPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Design, build, and deploy production-grade data pipelines, analytics engines, and Generative AI/LLM applications using Databricks, Spark, Python/PySpark, and modern cloud ecosystems.
- Serve as the primary technical leader on strategic enterprise client engagements.
- Partner with C-level executives, VP/Directors of Data, and engineering teams to translate business challenges into technical solutions.
- Lead complex legacy platform migrations, including Snowflake, Teradata, legacy Hadoop, and SQL Server, onto Databricks Lakehouse architecture.
- Guide enterprise customers in adopting GenAI solutions, RAG architectures, model fine-tuning, and MLflow/Databricks Mosaic AI integrations.
- Identify high-value technical use cases across client business units, expanding Databricks usage and driving measurable client ROI.
- Mentor junior Solution Engineers, Architects, and Consultants.
- Contribute to RevStar code libraries, reusable accelerators, and technical delivery best practices.
Requirements
What you’ll need- 5+ years of hands-on experience in Data Engineering, Machine Learning, or Solutions Architecture.
- 3+ years of deep technical experience within the Databricks Ecosystem (Delta Lake, Unity Catalog, MLflow, Spark/PySpark, Databricks Workflows/Jobs, Mosaic AI).
- Practical experience designing and deploying RAG pipelines, fine-tuning LLMs, working with vector databases, and managing ML pipelines end-to-end.
- Strong expertise in cloud-native architectures (AWS preferred—S3, Glue, Lambda, Redshift, etc.).
- Proven track record of migrating enterprise legacy data warehouses/lakes onto Databricks.
- Databricks Certified Data Engineer Professional and/or Machine Learning Professional preferred.
- Demonstrated track record of leading technical delivery for Fortune 500 or large enterprise clients.
- Healthcare, Retail, Consumer Goods experience is a strong plus.
- Exceptional verbal and written communication skills; comfortable presenting technical architecture, building POCs/demos, and managing client stakeholders up to the C-suite.
- Ability to spot technical expansion opportunities within existing client accounts and serve as a technical advocate to grow account footprint.
Benefits
Comp & perks- Paid Time Off – Take the time you need to recharge and stay productive.
- Remote-First Working Environment – Collaborate from anywhere while staying connected with our global team.
- Comprehensive Health Coverage – Medical, Dental, Vision
- 401(k) Retirement Plan – Plan for your future with access to a company-sponsored 401(k) program.
- Annual Learning & Development Stipend – Invest in your skills with conferences, certifications, or courses.
- Peer Mentorship & Coaching – Learn from experienced engineers, product managers, and architects to accelerate your growth.
- Professional Growth Opportunities – Exposure to cutting-edge AWS GenAI, data, and cloud technologies across diverse industries.
- Company Outings & Volunteer Opportunities – Build relationships and give back to the community.
- Collaborative, Innovative Culture – Work alongside top talent in a fast-paced, supportive environment that values curiosity and initiative.