FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and optimizing scalable data pipelines using Databricks, Python, and PySpark, while ensuring data integrity and quality across cloud environments, particularly Microsoft Azure. Proficient in data modeling, SQL query development, and implementing data engineering best practices to support analytics and business intelligence initiatives.
Highest-signal resume keywords
Databricks Data EngineeringPython DevelopmentPySpark ProcessingSQL Query OptimizationData Mesh Architecture
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DevelopmentData IngestionData TransformationData Delivery ProcessesBig Data ProcessingData ModelingVersion ControlTesting Best PracticesPipeline ObservabilityPerformance Analysis
Tools & Technologies
Microsoft AzureDatabricksPythonPySparkSQL
Industry Keywords
Data Mesh PrinciplesData GovernanceData SharingCloud Data EnvironmentsInformation Lifecycle Management
Tech Stack
Tools & technologiesAzureCloudPySparkPythonSQL
About the role
Key responsibilities & impact- Develop, maintain, and optimize scalable data pipelines using Databricks, Python, and PySpark
- Design, implement, and monitor data ingestion, transformation, and delivery processes for analytical and operational consumption
- Handle and process large volumes of data (Big Data), ensuring performance, reliability, and information quality
- Build solutions aligned with Data Mesh principles, promoting decentralization, governance, and data sharing across domains
- Develop and optimize SQL queries for data extraction, processing, and analysis
- Perform conceptual, logical, and physical data modeling to meet business and analytics needs
- Implement data engineering best practices, including version control, documentation, testing, and pipeline observability
- Work with cloud data environments, preferably Microsoft Azure, using data storage, processing, and integration services
- Ensure data integrity, security, and quality throughout the entire information lifecycle
- Support Analytics, BI, Data Science, and business teams by providing reliable, high-value data
- Participate in defining modern data architectures, contributing to the continuous evolution of the organization’s data platform
- Conduct performance analysis and process optimization to increase the efficiency of large-scale data processing
Requirements
What you’ll need- Experience with Databricks, including data engineering and processing
- Knowledge of Data Mesh architecture
- Experience building and maintaining data pipelines
- Development experience using Python and PySpark
- Experience with SQL and data modeling
- Experience working in cloud data environments, preferably Azure
Benefits
Comp & perks- Flexible work arrangements, which may include remote, hybrid, or onsite work, depending on project needs
- Structured career path and personalized learning tracks
- Corporate University with access to Harvard and Pluralsight
- Official certifications through partners such as SAP, AWS, Microsoft, and Salesforce
- Language courses with EF Education First (English, Spanish, French, and German)
- Medical and dental insurance
- TotalPass and Equilibrium programs supporting physical and mental well-being
- Private pension plan and life insurance
- Family Care Program: extended maternity and paternity leave, fertility support, and personalized health and well-being guidance
- Meal allowance
- Home office allowance
- Benefits club