FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowApacheAzureBigQueryCloudGoogle Cloud PlatformJavaPostgresPythonScalaSparkSQL
About the role
Key responsibilities & impact- Build and evolve reusable data engineering patterns for scalable onboarding of new data sources into the enterprise lakehouse
- Design and implement automated data management processes improving data quality, security, governance, and responsible handling of sensitive information
- Own technical deliverables end to end from solution design and development through testing, deployment, monitoring, and production support
- Design and build reusable data models, pipelines, frameworks, and components for multiple business use cases
- Improve performance, reliability, scalability, and maintainability while addressing technical debt
- Apply automated testing, data validation, CI/CD, observability, code reviews, and documentation
- Collaborate with Product and business stakeholders to translate requirements and KPIs into technical solutions
- Partner with Data, AI, and engineering teams to provide trusted, accessible data for analytics, AI applications, operational workflows, and enterprise processes
- Contribute to design discussions and technical decisions
- Mentor engineers and share engineering patterns, learnings, and best practices
- Identify gaps and opportunities in the data platform, tooling, and engineering processes
- Build data technology and pipelines that model varied data sources into reusable data models
- Support operational applications, analytics, metrics, and business processes using Palantir Foundry, AIP, and Ontology
Requirements
What you’ll need- 8–10+ years of experience in software or data engineering
- Experience building and supporting enterprise data platforms, data warehouses, lakehouses, or data-intensive applications
- Strong SQL skills and proficiency in Python, Scala, or Java
- Experience building complex data pipelines, transformations, reusable components, and data services
- Understanding of modern lakehouse architecture, including Delta Lake, Apache Iceberg, data modeling, partitioning, schema evolution, incremental processing, CDC, data quality, and performance tuning
- Strong experience with Databricks, including Delta tables, Spark, batch and streaming pipelines, performance optimization, and scalable data engineering practices
- Experience with cloud data platforms, especially GCP and/or Azure
- Experience with BigQuery, Azure, Databricks, Postgres, Dataflow, or similar platforms
- Experience with data orchestration and integration tools such as Airflow, Dagster, Fivetran, dbt, APIs, CDC, and other batch or streaming technologies
- Palantir Foundry, Ontology, or AIP experience is a strong plus, but not mandatory
- Good software engineering fundamentals, including modular design, version control, code reviews, automated testing, CI/CD, observability, troubleshooting, and production support
- Hands-on experience with automation and testing, including data quality checks, validation frameworks, reconciliation, and automated testing
- Experience building reusable data structures and engineering patterns
- Strong problem-solving and technical design skills
- Experience working with data at scale, including performance optimization and reliability improvements
- Comfortable working directly with business and product teams and translating requirements and KPIs into technical solutions
- Ability to take complex problems from design through development, testing, deployment, and production support
- Good communication skills
- Willingness to mentor and support other engineers
- Experience working across different business domains
- Strong ownership and execution
- Undergraduate degree in computer science or related discipline preferred, or equivalent experience
- Candidates should be comfortable with an on-site presence
- Full-time role
- Not able to sponsor visas for this position
- No C2C or C2H employment
Benefits
Comp & perks- Competitive compensation
- Generous vacation policy, paid holidays, and paid sick time
- Medical Insurance, Dental Insurance, and Vision Insurance (employee-paid)
- Company-paid Short-Term and Long-Term Disability Insurance
- Company-paid Group Life insurance
- Company-paid Employee Assistance Program (EAP) and Calm App subscription
- Employee-paid Pet Insurance and optional supplemental insurance coverage
- Vested 401(k) with company match and financial wellness programs
- Flexible Spending Account (FSA), Health Savings Account (HSA) and commuter benefits options
- Paid maternity leave, paid paternity leave, and fertility benefits
- Career growth and learning opportunities
- Wellness resources
- Employee discount programs
- Legal plan options
- Paid maternity leave and paid paternity leave, including for adoptive parents