FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Mid-Level Data Engineer
Stefanini Brasil. Develop, maintain, and enhance data ingestion, transformation, and processing pipelines (ETL/ELT) .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and maintaining data ingestion, transformation, and processing pipelines using Python and SQL, while ensuring data quality and integrity in distributed environments. Proficient in building workflows with Spark/PySpark and familiar with cloud environments, particularly Azure.
Highest-signal resume keywords
Python DevelopmentAdvanced SQL SkillsSpark/PySpark ExperienceETL/ELT Process DevelopmentData Quality Analysis
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data IngestionData TransformationData Processing PipelinesRelational DatabasesNoSQL DatabasesData ModelingMonitoring and LoggingPerformance Issue ResolutionTechnical DocumentationVersion Control with Git
Soft Skills
CollaborationProblem-SolvingAgile Methodologies
Tools & Technologies
SparkPySparkAzureData LakeData Warehouse
Industry Keywords
Data EngineeringDistributed EnvironmentsData QualityCloud EnvironmentsAgile Practices
Tech Stack
Tools & technologiesAzureCloudETLNoSQLPySparkPythonSparkSQL
About the role
Key responsibilities & impact- Develop, maintain, and enhance data ingestion, transformation, and processing pipelines (ETL/ELT)
- Work with large volumes of data in distributed environments
- Develop routines and solutions using Python and SQL
- Build and maintain distributed processing workflows using Spark/PySpark
- Support integrations across different data sources, systems, and platforms
- Analyze, address, and resolve issues related to data quality and integrity
- Implement monitoring, logging, alerting, and failure-handling mechanisms
- Support the deployment, versioning, and maintenance of solutions
- Identify and resolve performance issues in data pipelines and processes
- Create and maintain technical documentation
- Participate in technical discussions and contribute to the evolution of solutions
- Work with Senior Data Engineers, Specialists, Architects, and business teams
- Participate in delivery planning and tracking in an agile environment
Requirements
What you’ll need- Develop, maintain, and enhance data ingestion, transformation, and processing pipelines (ETL/ELT)
- Work with large volumes of data in distributed environments
- Develop routines and solutions using Python and SQL
- Build and maintain distributed processing workflows using Spark/PySpark
- Support integrations across different data sources, systems, and platforms
- Analyze, address, and resolve issues related to data quality and integrity
- Implement monitoring, logging, alerting, and failure-handling mechanisms
- Support the deployment, versioning, and maintenance of solutions
- Participate in identifying and resolving performance issues in data pipelines and processes
- Create and maintain technical documentation for developed solutions
- Participate in technical discussions and contribute to the evolution of solutions
- Collaborate with Senior Data Engineers, Specialists, Architects, and business teams
- Work in an agile environment, participating in delivery planning and tracking
- Professional experience in Data Engineering or related roles
- Strong knowledge of Python
- Advanced SQL skills
- Experience with Spark/PySpark
- Experience developing ETL/ELT processes
- Experience with relational and/or NoSQL databases
- Knowledge of Git and code version control practices
- Knowledge of Data Lake and Data Warehouse concepts and architectures
- Knowledge of Cloud environments, preferably Azure
- Knowledge of data modeling
- Knowledge of agile methodologies and practices
Benefits
Comp & perks- Meal or food allowance
- Discounts on courses, universities, and language schools
- Stefanini Academy — a platform offering free, up-to-date online courses with certificates
- Mentoring
- Benefits club for medical consultations and tests
- Health insurance
- Dental insurance
- Benefits and discounts at leading establishments
- Travel club
- Pet care benefits