FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building scalable and secure data pipelines for AI/ML workloads, with a strong focus on data governance, orchestration, and compliance. Proven ability to mentor junior engineers and collaborate effectively with cross-functional teams to drive technical initiatives.
Highest-signal resume keywords
Data Engineering ExperiencePython ProgrammingSQL ProficiencyCloud Platforms (Azure)Workflow Orchestration (Airflow)
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentData TransformationData Storage SolutionsFeature Store ImplementationMLOps PracticesStreaming Platforms (Kafka)Distributed Data Systems (Spark)DevOps PracticesCI/CD MethodologiesData Governance
Soft Skills
Strong CommunicationMentoringCollaboration
Tools & Technologies
DatabricksAzure Data LakeAzure Data FactorySynapseEvent HubVector Databases
Industry Keywords
AI/ML WorkloadsData Engineering ProcessesEnvironmental Health and SafetyCompliance StandardsTechnical Roadmaps
Tech Stack
Tools & technologiesAirflowAzureCloudKafkaPythonSparkSQL
About the role
Key responsibilities & impact- Lead the architecture and development of scalable, secure data pipelines supporting AI/ML workloads
- Own end to end data engineering processes: ingestion, transformation, storage, quality, and monitoring
- Collaborate with data scientists and ML engineers on model features, training pipelines, and deployment
- Drive best practices in data modeling, orchestration, versioning, and performance optimization
- Mentor and guide junior engineers; contribute to technical roadmaps and solution patterns
- Ensure data governance, lineage, and compliance standards are met across platforms
- Support real time and batch processing frameworks in production environments
- Comply with corporate policies, procedures, and security standards
- Contribute to a strong Environmental Health and Safety culture by following safety policies, identifying hazards, and engaging in continuous improvement
Requirements
What you’ll need- Bachelor's degree or higher in computer science (completed and verified prior to start)
- Seven (7) years of data engineering experience, including leading technical initiatives in a private, public, government or military environment
- Strong expertise in Python, SQL, and distributed data systems (e.g., Spark, Databricks, Synapse)
- Experience building AI/ML ready data pipelines, including feature stores and model training data flows
- Hands on experience with cloud platforms (Azure preferred — Data Lake, Data Factory, Databricks, Cosmos DB)
- Strong understanding of ML concepts, lifecycle, and MLOps practices
- Proven experience with workflow orchestration (Airflow, Data Factory, Synapse Pipelines, etc.)
- Strong communication and ability to translate business needs into technical solutions
- Experience with streaming platforms (Kafka, Event Hub)
- Familiarity with vector databases, embeddings, or LLM oriented data pipelines
- Background in DevOps, CI/CD, or infrastructure as code
- Experience designing data solutions for AI applications or intelligent platforms
- Must be legally authorized to work in country of employment without sponsorship for employment visa status (e.g., H1B status)
- Education and work history must be provided in the application
Benefits
Comp & perks- Medical, Dental & Vision
- Health Savings Accounts
- Health Care & Dependent Care Flexible Spending Accounts
- Disability Benefits
- Life Insurance
- Voluntary Benefits
- Paid Absences
- Retirement Benefits
- Up to 5% primarily domestic travel
- Remote work arrangement