FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing, deploying, and maintaining data platforms using Apache Airflow, Kubernetes, and Terraform. Proficient in automating CI/CD pipelines, optimizing cloud infrastructure costs, and mentoring engineering teams.
Highest-signal resume keywords
Apache Airflow ManagementKubernetes ExpertiseTerraform ProficiencyCI/CD Pipeline ArchitectureCloud Cost Optimization
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Apache AirflowKubernetesTerraformDockerArgoCDGitHub ActionsGrafanaPrometheusApache SparkSQL
Soft Skills
MentoringCollaborationProblem-Solving
Tools & Technologies
AWSAzureDataHubSnowflakeAzure SynapseDbtApache Kafka
Industry Keywords
DevOpsSite Reliability EngineeringBig DataData Platform EngineeringGitOps
Tech Stack
Tools & technologiesAirflowApacheAWSAzureCloudDockerGrafanaKafkaKubernetesPrometheusPythonSparkSQLTerraformGo
About the role
Key responsibilities & impact- Design, deploy, scale, and maintain highly available Apache Airflow clusters using Helm, Kubernetes, and Terraform
- Drive DevOps practices with Terraform, Helm Charts, and ArgoCD
- Automate platform deployments, manage self-hosted GitHub runners, and enforce GitOps workflows
- Architect and manage CI/CD pipelines using GitHub Actions for data pipelines, infrastructure components, and DAGs
- Provision and manage Kubernetes EKS/AKS clusters, Docker containers, and AWS/Azure cloud infrastructure
- Build and maintain monitoring, logging, and alerting systems using Grafana, Prometheus, Loki, and centralized log management solutions
- Build scalable data infrastructure for Apache Spark, AWS EMR, Snowflake, Azure Synapse, Apache Kafka, and dbt
- Deploy and maintain data discovery and metadata tooling such as DataHub
- Monitor, audit, and optimize AWS and Azure compute and storage costs
- Build internal tools, CLI utilities, and dynamic workflow templates
- Own data platform modules from architecture through deployment, production operations, and incident management
- Define and enforce engineering standards for code quality, design, testing, data lineage, security, access controls, IAM, and schema management
- Partner with data leads, product managers, and business stakeholders on a 1–2 year data platform roadmap
- Mentor junior and mid-level data platform engineers
Requirements
What you’ll need- 6+ years of hands-on professional experience in Data Platform Engineering, DevOps, or Site Reliability Engineering supporting big data environments
- Deep production experience managing, tuning, dynamically scaling, and troubleshooting Apache Airflow infrastructure
- Expert-level skills in Kubernetes, Helm, Terraform, Docker, ArgoCD, and GitHub Actions, including custom runner configurations
- Proven experience configuring production alerting, metrics collection, and log aggregation using Grafana, Prometheus, and Loki
- Deep operational and configuration experience with Spark, AWS EMR, Snowflake, Azure Synapse, dbt, and Apache Kafka
- Hands-on experience with AWS and/or Azure, with a demonstrated history of cloud cost optimization
- Experience deploying or managing data cataloging tools such as DataHub, Amundsen, or similar metadata management platforms
- Strong programming skills in Python, Bash, Go, or SQL
- Comfortable taking complex architectural requirements from concept to production-grade deployment
- Driven to replace manual operational tasks with code, automated tests, automated CI/CD checks, and resilient self-healing infrastructure
- Must reside within 30 miles of Portland, ME; Boston, MA; Chicago, IL; Dallas, TX; San Francisco Bay Area, CA; or Seattle, WA
Benefits
Comp & perks- Health, dental, and vision insurance
- Retirement savings plan
- Paid time off
- Health savings account
- Flexible spending accounts
- Life insurance
- Disability insurance
- Tuition reimbursement
- Quarterly or annual bonus eligibility for non-sales roles
