FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Mid-Level Data Engineer
SysMap Solutions. Develop, maintain, and enhance data pipelines using Python, PySpark, and Databricks .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Data Engineering with a strong focus on developing and maintaining data pipelines using Python, PySpark, and Databricks. Proficient in ETL/ELT processes, SQL, and cloud environments such as AWS or Azure, while ensuring data quality and optimizing workflows.
Highest-signal resume keywords
Data Engineering ExperiencePython ProgrammingPySpark DevelopmentETL/ELT ProcessesDatabricks Proficiency
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonPySparkSQLETLELTDatabricksGitDelta LakeDimensional Data ModelingCI/CD
Soft Skills
AutonomyProactivityOrganizationStrong CommunicationProblem-Solving
Tools & Technologies
Databricks WorkflowsAirflowAWSAzureUnity Catalog
Industry Keywords
Data GovernanceLakehouse ArchitectureMedallion ArchitectureHigh-Volume Transactional EnvironmentsPerformance Optimization
Tech Stack
Tools & technologiesAirflowAWSAzureCloudETLPySparkPythonSQLUnity
About the role
Key responsibilities & impact- Develop, maintain, and enhance data pipelines using Python, PySpark, and Databricks
- Build, integrate, and support ETL/ELT processes
- Perform data queries, transformations, and optimization using SQL
- Work with notebooks, jobs, and data processing in the Databricks environment
- Investigate, identify, and resolve data pipeline failures
- Apply development best practices and manage code versioning with Git
- Ensure the quality and efficiency of data workflows
- Propose technical improvements and work autonomously to execute tasks
- Collaborate with technical teams and business areas to resolve problems
- Work at SysMap Group, a Brazilian technology company that helps organizations overcome complex challenges and accelerate their digital transformation
Requirements
What you’ll need- Hands-on experience in Data Engineering
- Knowledge of Python and PySpark for developing and maintaining pipelines
- Intermediate to advanced SQL skills
- Hands-on experience with Databricks, notebooks, and jobs
- Experience building and supporting ETL/ELT processes
- Knowledge of Delta Lake, Lakehouse architecture, and the medallion architecture (Bronze, Silver, and Gold)
- Experience with Git and version control best practices
- Ability to investigate and resolve technical issues in pipelines
- Autonomy, proactivity, organization, and strong communication skills
- Analytical, collaborative, and problem-solving mindset
- Experience with AWS or Azure cloud environments
- Knowledge of Databricks Workflows/Jobs or Airflow
- Experience with dimensional data modeling
- Knowledge of Unity Catalog and data governance
- Experience with CI/CD and performance optimization
- Experience in high-volume transactional environments
Benefits
Comp & perks- No benefits, perks, or additional compensation details are explicitly provided in the job posting