FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in lakehouse implementation and data architecture, with a strong focus on data identity and entity resolution. Proficient in building and maintaining data pipelines, ensuring quality reporting, and collaborating effectively in a fast-paced engineering environment.
Highest-signal resume keywords
Lakehouse ImplementationData Identity ResolutionPython ProgrammingSQL ProficiencyBatch Data Pipelines
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Lakehouse DesignData Warehouse OperationsData Ingestion PatternsEntity ResolutionCost Efficiency in Data PipelinesTechnical Decision RecordsData Quality ReportingWeb ScrapingOCR API IntegrationArchitectural Trade-offs
Soft Skills
CollaborationComfort with AmbiguityFast-Paced Environment Adaptability
Tools & Technologies
DuckDBDuckLakeS3 ParquetPostgresDynamoDBPrefectKubernetesTerraformQuarto ReportingGitHub Actions
Industry Keywords
Food EnrichmentData AssemblyMedallion ArchitectureStar Schema
Tech Stack
Tools & technologiesAirflowAssemblyAWSCloudDistributed SystemsDynamoDBKubernetesPostgresPythonSparkSQLTerraform
About the role
Key responsibilities & impact- Own end-to-end lakehouse implementation and collaborate on data/platform architecture
- Build source-ingestion patterns for APIs, public-source text, and external databases
- Merge product records across retailers and dates through identity and entity resolution
- Determine winning sources for conflicting values while preserving original source records for traceability
- Consolidate existing food-enrichment pipelines into a single pipeline
- Build connectors to deliver consolidated food data to WISE Intel and the consumer app
- Maintain fail-fast configuration discipline and early failures for missing settings
- Establish ingestion capabilities and quality reporting for Data Assembly readiness
- Write concise, dated technical decision records before code implementation
- Work as a senior individual contributor alongside the Data team and second engineer on The Pantry
Requirements
What you’ll need- 3+ years of experience in a similar role
- Proven track record of designing and shipping a lakehouse or data warehouse from scratch, and operating it for at least one year in production
- Demonstrated experience treating data identity and entity resolution as first-class architectural questions
- Experience running batch data pipelines that invoke paid cloud/third-party APIs at scale with strict cost efficiency and budget controls
- Experience pairing daily with other engineers in a fast-paced environment
- Native proficiency in Python and SQL
- Experience with DuckDB, DuckLake, S3 Parquet, Postgres, DynamoDB, Prefect, Kubernetes/Fargate job runners, AWS infrastructure, Terraform, IAM, Quarto reporting, Medallion architecture, star schema, and GitHub Actions
- Familiarity with dbt, Dagster, or Airflow
- Comfort with ambiguity and pace
- Preferred: architectural trade-offs between DuckDB and distributed systems such as Spark, Databricks, or Snowflake
- Preferred: data acquisition methods such as web scraping and OCR API integration
- Food or nutrition domain knowledge, deep Spark/Databricks/Snowflake experience, and people management experience are explicitly not required
Benefits
Comp & perks- Fully remote
- Unlimited PTO
- 10 paid holidays
- 401(k) with a 4% company match, immediately vested
- Comprehensive medical, dental, vision, life, and additional ancillary coverage
- 100% coverage for employees, with 80% covered for dependents
- 100% employer paid STD, LTD, Identity Theft, and Life insurance
- FSA and HSA plans available
- $200/month HSA contributions for Employee plans
- $400/month HSA contributions for Employee + Dependent plans
- Competitive bonus
- Meaningful equity