FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and maintaining scalable data pipelines and machine learning solutions in cloud environments, with a strong focus on data governance, quality, and model lifecycle management. Proficient in leveraging tools like Databricks and agentic coding tools to enhance software development and deployment processes.
Highest-signal resume keywords
Databricks Platform ExperiencePython ProficiencyCI/CD Pipeline ManagementMachine Learning Model DeploymentCloud Environment Expertise
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignData Quality FrameworksData ModellingMLOps PracticesInfrastructure as CodeSQL ProficiencyAgentic Coding ToolsContainerizationAutomated DeploymentStreaming Workloads
Soft Skills
Collaborative Software DevelopmentClear Specification WritingProblem-Solving
Tools & Technologies
AzureAWSGCPClaude CodeDatabricksGitCI/CD ToolsAutomated Testing
Industry Keywords
Data GovernanceLakehouse ArchitectureMachine LearningGenerative AIData Integration
Tech Stack
Tools & technologiesAWSAzureCloudERPGoogle Cloud PlatformPythonSQL
About the role
Key responsibilities & impact- Design, build, and maintain reliable, scalable data pipelines for batch and streaming workloads
- Apply lakehouse architecture patterns with clear data contracts and managed schema evolution
- Build data quality checks, testing, and monitoring into pipelines
- Design analytical data models aligned with business requirements and scale
- Profile, explore, and analyze data to validate assumptions and surface quality issues
- Apply data governance practices so data assets are secure, traceable, and discoverable
- Build, train, and evaluate machine learning and generative AI solutions, including classical ML, LLM-based, and agentic applications
- Establish business-aligned evaluation approaches for models
- Move models from experimentation to reliable, observable, maintainable production deployments
- Build and maintain CI/CD pipelines for code, data, and models
- Manage cloud and platform resources through infrastructure as code
- Implement model lifecycle management, including versioning, deployment, monitoring, drift detection, and retraining
- Champion code reviews, branching strategies, automated testing, and documentation
- Use agentic coding tools such as Claude Code for design, development, testing, documentation, and refactoring
- Provide agents with effective context through specifications, project instructions, and reusable workflows
- Review, test, and validate AI-generated code and own shipped quality
- Share and codify effective agentic workflows
- For client delivery: deliver engineering workstreams on fixed-price engagements from technical discovery through outcome acceptance
- For client delivery: work across Azure, AWS, and GCP client environments
- For client delivery: partner with Architects and the Engineering Manager within scope, timeline, and commercial constraints
- For client delivery: participate in client workshops, demos, and technical working sessions
- For client delivery: identify scope creep, technical risks, and blockers
- For client delivery: document solutions, transfer knowledge, and build client capability
- For client delivery: contribute reusable accelerators, templates, and patterns
- For internal data and analytics: integrate CRM, PSA, finance/ERP, and HR data into Azure Databricks
- For internal data and analytics: clean, reconcile, and standardize internal data and establish sources of truth
- For internal data and analytics: coordinate resolution and prevention of data quality issues
- For internal data and analytics: build documented data models for analytics, KPIs, and reporting
- For internal data and analytics: partner with Finance, Sales, Operations, and leadership on reporting needs
- For internal data and analytics: design and automate quote-to-cash workflows
Requirements
What you’ll need- 4+ years in software and platform engineering, including meaningful time on a collaborative software development team
- Hands-on experience building production data and ML solutions in the cloud
- Strong, demonstrable experience with the Databricks platform in production environments
- Practical experience using agentic coding tools, such as Claude Code, to accelerate software development
- Strong proficiency in Python and SQL
- Solid software engineering fundamentals, including Git workflows, code review, unit and integration testing, and modular design
- Hands-on experience with CI/CD tooling and infrastructure as code
- Comfort with containerization, environment management, and automated deployment
- Working knowledge of Azure, AWS, and GCP, with deep hands-on experience in at least one
- Understanding of data platform deployment and integration across storage, identity, networking, and security
- Familiarity with native data and AI services across Azure, AWS, and GCP
- Deep hands-on Databricks experience across data engineering, governance, and ML/AI capabilities
- Experience deploying and managing Databricks solutions using software engineering and DevOps best practices
- Ability to design and build scalable batch and streaming pipelines
- Strong data modelling skills across dimensional and modern lakehouse patterns
- Experience with data quality frameworks, testing, and observability
- Practical experience building, evaluating, and deploying ML models to production
- Experience with generative AI patterns such as retrieval-augmented generation, agents, and LLM evaluation
- Strong MLOps practices across the full model lifecycle
- Hands-on proficiency with agentic development tools such as Claude Code
- Ability to decompose work, write clear specifications, and manage context so agents produce high-quality results
- Sound judgment on AI-assisted development risks and disciplined review and testing of AI-generated output
Benefits
Comp & perks- Equal opportunity employer
- Inclusive work environment welcoming members of all backgrounds and perspectives
- Accommodations or adjustments throughout the interview process and beyond, upon request