FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates extensive experience in data engineering and architecture, particularly in modernizing legacy ETL workloads into lakehouse architectures. Proficient in technical leadership, data governance, and cloud architecture design, with a strong focus on SQL Server and Azure data platforms.
Highest-signal resume keywords
Data EngineeringLakehouse ArchitectureApache SparkSQL ServerData Governance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data ModelingT-SQLSSISPySparkDelta LakeMedallion ArchitectureData LineageCI/CDPull Request ReviewsTechnical Oversight
Soft Skills
Strong Communication SkillsDecision-Making
Tools & Technologies
Azure Cloud Data PlatformsAzure DevOpsGitDatabricksUnity Catalog
Industry Keywords
ETL WorkloadsLakehouse PatternsData Warehouse ConceptsAutomated AnalysisTechnical Direction
Tech Stack
Tools & technologiesApacheAzureCloudETLKafkaPySparkSparkSQLSSISUnity
About the role
Key responsibilities & impact- Analyze legacy production workloads by reverse engineering Alteryx workflows, SSIS packages, and SQL Server jobs.
- Identify actual behavior, undocumented dependencies, historical fixes, and implicit business logic.
- Audit automated analysis reports against original source artifacts and resolve discrepancies, omissions, and unsupported assumptions.
- Define target lakehouse architecture, ingestion patterns, data types, partitioning strategies, naming conventions, and scalability standards.
- Establish data modeling, lineage, access, governance, and Unity Catalog security practices.
- Review and formally approve documented design plans before authorizing automated code generation.
- Resolve technical escalations, business ambiguities, and multi-agent system limitations requiring human intervention.
- Provide technical direction and unblock up to three engineers or developers simultaneously.
- Review and approve pull requests targeting protected branches such as preprod and main.
- Document assumptions, alternatives, trade-offs, and approvals for architecture decision traceability and auditability.
- Validate automated analysis and provide technical oversight within an AI-assisted modernization workflow.
Requirements
What you’ll need- Senior-level experience in data engineering and data architecture, with direct ownership of cloud architecture design decisions.
- Demonstrated experience leading the modernization of legacy ETL workloads into lakehouse architectures.
- Hands-on experience with Apache Spark in production and PySpark for data processing and transformation.
- Strong knowledge of Delta Lake, Medallion architecture, lakehouse patterns, and data warehouse concepts.
- Experience with Azure cloud data platforms.
- Strong working knowledge of SQL Server, T-SQL, and SSIS, including the ability to investigate existing ETL logic and dependencies.
- Experience with data modeling, data governance, and data lineage.
- Working knowledge of Azure DevOps, Git-based collaboration, CI/CD, and pull request reviews.
- Experience providing technical leadership to engineers or developers; formal people management experience is not required.
- Ability to make sound decisions with incomplete information, validate assumptions, and document the reasoning behind technical choices.
- Strong communication skills to explain design decisions, clarify business rules, and coordinate implementation.
- English proficiency sufficient to participate independently in technical discussions and produce clear documentation.
- Nice to have — non-blocking: hands-on experience with Databricks and Unity Catalog.
- Nice to have — non-blocking: experience analyzing or migrating Alteryx workflows.
- Nice to have — non-blocking: experience with streaming technologies such as Solace, Kafka, or Lakeflow.
- Nice to have — non-blocking: broader DevOps experience supporting data platform delivery.
- Nice to have — non-blocking: experience with SAST controls and vulnerability management tools, such as Fluid Attacks or similar platforms.
- Nice to have — non-blocking: experience reviewing AI-generated analysis or code within an engineering workflow.
Benefits
Comp & perks- Work with global brands and disruptive startups.
- Remote work/Home office.
- Schedule aligned with your assigned team/project.
- Work Monday through Friday.
- Day off on your birthday.
- Major medical expenses insurance (applies to Mexico).
- Life insurance (applies to Mexico).
- Multicultural teams.
- Access to courses and certifications.
- Virtual team-building events and interest groups.
- English classes.
- Opportunities within our different business lines.
- Proudly certified as a Great Place to Work.
