FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Engineer – Analytics Lead
OPENDataJobs. Build critical components for three production data products for a federal agency .
Tech Stack
Tools & technologiesAzureCloudETLPySparkPythonServiceNowSQLUnityVault
About the role
Key responsibilities & impact- Build critical components for three production data products for a federal agency
- Integrate partner work and conduct technical review before acceptance
- Own data quality and deliver documented deduplication, reconciliation, and data quality controls
- Build reliable ingestion and transformation pipelines across legacy, current-system-of-record, and multi-format contractor data
- Create traceable source-to-target mappings
- Develop Data Vault 2.0 and Gold tier models supporting required analytics and independent agency analyst querying
- Build integrated semantic models and support Microsoft Power BI
- Optimize performance and deliver production-ready code
- Create data dictionaries, pipeline specifications, runbooks, and knowledge-transfer materials
- Help ensure products remain understandable and supportable after cutover
- Collaborate with developers, engineers, data scientists, architects, strategists, and machine learning engineers
- Help develop the firm's capabilities, tools, and lines of business
Requirements
What you’ll need- 8+ years in data engineering or analytics engineering, including at least three years with Azure Databricks or a comparable lakehouse platform
- Advanced Structured Query Language (SQL) and Python or PySpark
- Experience with Delta Lake, ETL, ELT, orchestration, schema design, data quality, and performance tuning
- Hands-on experience with Data Vault 2.0, dimensional modeling, semantic models, and production analytics
- Working familiarity with Unity Catalog, source control, automated deployment, environment promotion, and CI/CD
- Ability to support Microsoft Power BI datasets and dashboards
- Ability to collaborate with machine learning engineers on feature pipelines and model deployment
- Strong technical writing and ability to maintain diagrams, mappings, specifications, and runbooks
- United States citizenship
- Dual citizenship and green card holders are prohibited by the contract terms
- Ability to satisfy required suitability, security, and access requirements
- Preferred: Experience on a federal system accredited at Impact Level 5 (IL-5) or higher
- Preferred: Databricks Data Engineer, Azure Data Engineer, or relevant cloud certification
- Preferred: ServiceNow data, federal audit data, government financial data, or controlled federal environments
- Preferred: Experience moving solutions between Azure environments using infrastructure as code and Databricks Asset Bundles
Benefits
Comp & perks- Medical, dental, and vision with the employee premium fully paid and half of dependent premiums
- Employer-paid life, accidental death, and short-term and long-term disability insurance
- 401(k) matched 100% up to 4% of salary, vesting immediately
- Unlimited paid time off
- Sponsored professional certifications and continuing education
- Extensive onboarding
- Rotation across functions to expand skills and perspective