FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and operating production data platforms, with a strong focus on AWS environments, data pipeline design, and troubleshooting distributed data-processing systems. Proficient in Python and SQL for automation and tooling to enhance data quality and operational resilience.
Highest-signal resume keywords
Production Data Pipeline DevelopmentAWS Data Services ExperiencePython and SQL ProficiencyTroubleshooting Distributed Data-Processing SystemsIncident Response and Root Cause Analysis
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignProduction Data ArchitectureData Quality MonitoringBackfills and ReprocessingRoot Cause AnalysisData ValidationSchema Changes ManagementPerformance TroubleshootingAutomation with PythonSQL Querying
Soft Skills
Problem-SolvingCommunication with StakeholdersCollaboration with Data Engineering Teams
Tools & Technologies
AWS EMRAWS S3AWS GlueAWS RedshiftAWS DynamoDBAWS LambdaSnowflake
Industry Keywords
Data QualityData FreshnessData LatencyOperational DocumentationOn-Call Rotation
Tech Stack
Tools & technologiesAmazon RedshiftAWSCloudDynamoDBPythonSparkSQL
About the role
Key responsibilities & impact- Own production data pipeline and platform reliability
- Resolve failures, delays, data quality issues, and performance problems
- Troubleshoot distributed data-processing workloads across Spark/EMR, ingestion pipelines, Redshift, and Snowflake
- Lead or support incident response, perform root cause analysis, restore data safely, and implement lasting fixes
- Define and monitor data SLAs for freshness, latency, and completeness
- Improve monitoring, alerting, and observability
- Diagnose late-arriving data, incomplete loads, duplicate data, schema changes, and reconciliation failures
- Perform safe backfills, reprocessing, and production data recovery
- Develop Python and SQL automation and tooling to reduce operational toil and improve resilience
- Identify and address data-platform performance and cost issues
- Partner with Data Engineering teams on pipeline design, data quality, reliability, and production readiness
- Support disaster recovery, backup validation, and recovery workflows
- Create and maintain runbooks, SOPs, and operational documentation
- Participate in an on-call rotation for production data systems
Requirements
What you’ll need- 5+ years of hands-on experience building, operating, or supporting production data platforms, with significant recent experience in AWS environments
- Hands-on experience designing, building, deploying, and operating production-grade data pipelines
- Prior experience building data pipelines through production, including real-world failures and operational challenges
- Strong hands-on Python and SQL experience in production data environments
- Hands-on experience troubleshooting distributed data-processing systems such as Spark/EMR
- Experience with AWS data services such as EMR, S3, Glue, Redshift, DynamoDB, Lambda, or similar
- Experience operating or troubleshooting cloud data warehouses such as Redshift, Snowflake, or similar
- Strong understanding of end-to-end production data architecture, including ingestion, processing, orchestration, storage/warehousing, data quality, monitoring, and downstream consumption
- Experience handling production incidents and performing root cause analysis
- Experience with data validation, reconciliation, backfills, reprocessing, and late or incomplete data
- Strong problem-solving skills for ambiguous production data issues
- Strong communication during incidents with technical and non-technical stakeholders
- Ability to participate in an on-call rotation and occasional change windows outside normal business hours
- Applicants must be authorized to work for any employer in the U.S.; no employment visa sponsorship, including CPT/OPT
- Technical assessments must be completed independently
- Final candidates may be subject to identity, employment, education, certification, reference, and background verification
- Reliable high-speed internet with a wired connection and suitable home workspace for remote work
Benefits
Comp & perks- Medical, dental, vision and life insurance
- Retirement savings – 401(k) plan with generous company matching contributions (up to 6%), financial advisory services, potential company discretionary contribution, and a broad investment lineup
- Tuition reimbursement up to $5,250/year
- Business-casual environment that includes the option to wear jeans
- Generous paid time off upon hire – including a paid time off program plus ten paid company holidays and three floating holidays each calendar year
- Paid volunteer time — 16 hours per calendar year
- Leave of absence programs – including paid parental leave, paid short- and long-term disability, and Family and Medical Leave (FMLA)
- Business Resource Groups (BRGs) facilitating inclusion and collaboration
- Bonus program opportunity for non-sales positions
- Reliable high-speed internet and wired connection required for remote/hybrid work
- Necessary computer equipment provided
