FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building data ingestion and transformation processes using PySpark within AWS environments, while applying software development best practices and collaborating with multidisciplinary teams to drive data-driven insights. Proficient in designing strategic data architectures and utilizing advanced Python programming for data applications.
Highest-signal resume keywords
PySpark DevelopmentAWS Cloud ServicesBig Data EcosystemsData Visualization ToolsTechnical Leadership
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Advanced Python ProgrammingDistributed ProcessingETL ToolsData Lake DevelopmentAgile FrameworksData Architecture DesignProcess AutomationBig Data TechnologiesSpark SQLHadoop
Soft Skills
Excellent Communication SkillsStrong Time-Management SkillsCollaborative MindsetProblem-Solving OrientationAdaptability to Change
Tools & Technologies
Power BIQuickSightAirflowControl-MPowerCenterDataStagePentahoKafkaHDFSMapReduce
Certifications & Qualifications
Cloud Certification
Industry Keywords
Business IntelligenceData-Driven InsightsData IngestionData TransformationSoftware Development Best Practices
Tech Stack
Tools & technologiesAirflowAWSAzureCloudETLGoogle Cloud PlatformHadoopHDFSKafkaMapReducePySparkPythonSpark
About the role
Key responsibilities & impact- Build data ingestion and transformation processes using PySpark in an AWS cloud environment
- Apply software development best practices for distributed processing
- Build and evolve the data lake while working in multidisciplinary squads
- Discuss business needs with stakeholders, contributing to new products and data-driven views that uncover discoveries and generate insights for the business and products
- Understand and apply best practices for implementing data projects
Requirements
What you’ll need- Bachelor’s degree in Computer Science, Computer Engineering, Systems Analysis, or a related field
- Knowledge of cloud services and software architecture, preferably AWS; Azure or GCP also considered
- Strong knowledge of Big Data ecosystems, including Hadoop, HDFS, MapReduce, Kafka, and more
- Strong knowledge of distributed processing, including Spark, RDDs, PySpark, and Spark SQL
- Knowledge of ETL tools such as PowerCenter, DataStage, Pentaho, or similar platforms
- Knowledge of process automation tools such as Airflow and Control-M
- Advanced Python programming for data applications
- Knowledge and practical experience with Agile frameworks
- Technical leadership experience, strong time-management skills, and excellent communication skills, including the ability to explain data-related concepts to non-specialists
- Adaptability to change and a mindset focused on process innovation
- Experience designing strategic data architectures
- Strong knowledge of data visualization and front-end tools such as Power BI, QuickSight, or similar platforms
- Collaborative mindset, problem-solving orientation, and strong interpersonal skills
- Advanced English is a plus
- Preferred: knowledge of Business Intelligence
- Preferred: cloud certification
Benefits
Comp & perks- Porto Seguro medical insurance, with the option to add a spouse and children
- Porto Seguro dental insurance for employees and dependents
- Profit-Sharing and Results Program (PLR)
- Childcare assistance
- Alelo meal and food allowances
- Proportional home-office allowance
- Partnerships with educational institutions, offering discounts and incentives for courses and degree programs
- Certification incentives, including cloud certifications in GCP, Azure, AWS, and others
- Livelo points
- TotalPass
- MindSelf, with incentives for meditation and mindfulness
- Ongoing professional development
