FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Engineer
Horizon3.ai. Design, build, and maintain business-critical data pipelines, including data ingestion and AWS Glue/Spark jobs feeding the warehouse and Tableau .
Tech Stack
Tools & technologiesAirflowApacheAWSCloudDistributed SystemsPythonSparkSQLTableauTypeScript
About the role
Key responsibilities & impact- Design, build, and maintain business-critical data pipelines, including data ingestion and AWS Glue/Spark jobs feeding the warehouse and Tableau
- Build and operate the data warehouse, orchestration, and BI/reporting platform across multiple regions
- Help evaluate and shape the warehouse strategy, including lakehouse platforms such as Databricks
- Define and evolve batch or event-driven contracts between producer and consumer teams
- Reason through batch versus streaming, CDC, reprocessing, and multi-tenant/multi-region trade-offs
- Design and evolve warehouse schemas and data models
- Build observability into pipelines and platform components
- Drive work across producer and consumer teams, communicate clearly, and own outcomes end to end
- Expand the data platform for Federal workloads and the product portfolio
Requirements
What you’ll need- Strong software engineering skills, including clean, correct, maintainable code and solid data-structure and problem-solving fundamentals
- Deep understanding of distributed systems and data architecture
- Fluent SQL and strong data-modeling skills
- Experience owning production data infrastructure end to end
- Experience working within US Government enclaves from FedRAMP through TS cloud environments
- 7+ years of professional experience in data engineering, infrastructure engineering, or backend software engineering
- Bachelor’s degree in Computer Science or a related field, or equivalent practical experience
- Experience with cloud-based data platforms and distributed data processing, such as AWS Glue, Databricks, Snowflake, or Spark-based pipelines
- Experience with Tableau or a comparable BI platform
- SQL and Python proficiency
- Experience with workflow orchestration tools such as Apache Airflow, Dagster, or similar
- US citizenship
- Ability to gain and maintain a TS Security clearance
Benefits
Comp & perks- Equity package in the form of stock options for all full-time roles
- Health, vision, and dental insurance for you and your family
- Flexible vacation policy
- Generous parental leave
- Career development opportunities
- Inclusive and collaborative culture
- Remote and hybrid work models depending on role and location