FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Engineer
Marathon Petroleum Corporation. Design, develop, and optimize scalable data pipelines and cloud-based data solutions .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and optimizing scalable data pipelines and cloud-based data solutions using Azure data services. Proficient in data integration, governance, and implementing data security measures while collaborating across teams to ensure effective data architecture and quality.
Highest-signal resume keywords
Azure Data ServicesPython ProgrammingSQL ProficiencyData Pipeline DevelopmentData Governance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data EngineeringETL ProcessesData Ingestion FrameworksData Quality MethodologiesScalable Data ModelsBig Data TechnologiesNoSQL DatabasesReal-Time ProcessingData Security TechniquesMetadata Management
Soft Skills
CollaborationProblem SolvingMentoring
Tools & Technologies
Azure Data FactoryDatabricksHadoopSparkAzure FunctionsSynapse AnalyticsMonitoring ToolsObservability Tools
Industry Keywords
Data Privacy RegulationsCybersecurity Best PracticesData Lifecycle ManagementDevOps Practices
Tech Stack
Tools & technologiesAWSAzureCloudCyber SecurityETLGoogle Cloud PlatformHadoopNoSQLPythonSparkSQL
About the role
Key responsibilities & impact- Design, develop, and optimize scalable data pipelines and cloud-based data solutions
- Use Azure data services, including Data Lake, Synapse Analytics, Azure Functions, and Databricks
- Collaborate with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions
- Conduct the design, innovation, and optimization of data extraction, ingestion, and transformation processes
- Facilitate the development and design of complex data architecture for high-volume datasets
- Enable complex data pipelines and implement data security and privacy measures
- Conduct complex data quality and processing tasks using open-source and cloud services
- Provide technical expertise during critical incidents
- Collaborate across departments to ensure seamless data integration
- Implement continuous improvements in data processing methods and drive consistency and best practices
- Solve complex problems and participate in strategic planning for data infrastructure
- Oversee quality assurance and testing for data solutions
- Mentor less experienced data engineers
- Contribute to engineering standards, reusable patterns, and solution design reviews
Requirements
What you’ll need- Bachelor’s Degree in Information Technology or related field required
- 5+ years of relevant data engineering experience required
- Strong proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows
- Familiarity with big data technologies and frameworks, such as Hadoop, Spark, and distributed computing
- Knowledge of cloud-based data platforms, such as AWS, Azure, or GCP, and associated data services
- Ability to establish and oversee data governance procedures, policies, and standards
- Proficiency in data integration using ETL processes, data pipelines, and data ingestion frameworks
- Skill in designing and implementing scalable data models
- Understanding of data operations throughout the data lifecycle
- Ability to implement data privacy practices and manage data access rights and consent protocols
- Strong understanding of data quality dimensions, methodologies, and best practices
- Knowledge of data privacy regulations, cybersecurity best practices, and data security techniques
- Knowledge of monitoring and observability tools and practices
- Understanding of DevOps practices
- General programming proficiency
- Proficiency in metadata management solutions
- Knowledge of NoSQL databases
- Knowledge of real-time processing
Benefits
Comp & perks- Health, vision, and dental insurance
- Paid time off
- 401k matching program
- Paid parental leave
- Educational reimbursement
- Discretionary company-sponsored annual bonus program