FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and maintaining scalable data pipelines and ETL workflows using Databricks and Azure services. Proficient in Python and SQL for data processing, with a strong focus on data quality, performance, and governance.
Highest-signal resume keywords
DatabricksPython ProgrammingSQL Performance TuningMicrosoft AzureData Engineering
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentETL WorkflowsDelta Lake ArchitectureComplex SQL QueriesData Processing AutomationCI/CD Best PracticesSpark Performance OptimizationData GovernanceCloud SecurityAgile Methodologies
Soft Skills
Problem-SolvingCollaborationIndependent Work
Tools & Technologies
Azure Data LakeAzure Data FactoryAzure DevOpsGitHub Actions
Industry Keywords
Data EngineeringSoftware DevelopmentDigital TransformationDistributed Data Systems
Tech Stack
Tools & technologiesAzureCloudETLPythonSparkSQL
About the role
Key responsibilities & impact- Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks
- Build and optimize Delta Lake architectures and data models
- Develop high-quality, reusable Python code for data processing and automation
- Write and optimize complex SQL queries for large datasets
- Implement and manage solutions on Microsoft Azure, including Azure Data Lake and Azure Data Factory
- Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high-quality solutions
- Ensure data quality, reliability, and performance across all pipelines
- Troubleshoot production issues and perform root-cause analysis
- Follow best practices for version control, CI/CD, and cloud security
- Analyze data and support digital transformation initiatives to help identify and bridge business gaps
Requirements
What you’ll need- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (minimum requirement)
- 8–10+ years of experience in data engineering or software development
- Strong hands-on experience with Databricks, including notebooks, jobs, clusters, and Delta Lake
- Advanced proficiency in Python for data engineering
- Strong expertise in SQL, including performance tuning
- Solid experience with Microsoft Azure cloud services
- Experience working with large-scale distributed data systems
- Strong problem-solving skills and ability to work independently
- Experience with CI/CD tools (Azure DevOps, GitHub Actions) preferred
- Knowledge of Spark performance optimization preferred
- Experience with data governance and security frameworks preferred
- Familiarity with Agile methodologies preferred
- Experience working in structured environments with established standards, methodologies, and governance processes preferred
- Local candidates only for Lansing, Michigan
Benefits
Comp & perks- Remote work option
- Contract employment