FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and optimizing data pipelines, ensuring performance and security across cloud environments such as AWS, Azure, or Google Cloud Platform. Proficient in implementing CI/CD practices and managing large data volumes using technologies like Snowflake, Spark, and Python.
Highest-signal resume keywords
Cloud Environment ProficiencyData Platform KnowledgeBig Data Technologies ExperienceCI/CD Environment ExperienceDistributed Architecture Management
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonSQLSparkPySparkKafkaSnowflakeDatabricksBigQueryCI/CDAutomated Testing
Soft Skills
Analytical MindsetAttention to DetailCritical ThinkingTeam CollaborationStrong Communication
Tools & Technologies
AWSAzureGoogle Cloud PlatformAirflowGitMonitoring Tools
Industry Keywords
Data PipelinesETLELTData GovernanceScalabilityCloud Cost Optimization
Tech Stack
Tools & technologiesAirflowAWSAzureBigQueryCloudETLFluxGoogle Cloud PlatformJavaKafkaPySparkPythonSparkSQLTypeScript
About the role
Key responsibilities & impact- Contribute to the development, optimization, and industrialization of critical data pipelines
- Define architecture standards and contribute to key technology decisions
- Build, industrialize, and optimize batch and streaming data pipelines (ETL/ELT)
- Ensure the performance, resilience, availability, and security of data platforms
- Implement strategies for managing development, test, and production environments, as well as automated deployment
- Ensure the technical governance of data flows, including traceability, lineage, and dependency management
- Audit and improve existing processes to enhance their robustness and maintainability
- Implement software quality best practices, including automated testing, CI/CD, monitoring, and observability
- Anticipate data volume, scalability, and cloud cost optimization challenges
- Collaborate with Data Science, ML, Product, and business teams
- Contribute to the technical roadmap and the prioritization of key initiatives
- Document architectures and facilitate knowledge transfer
Requirements
What you’ll need- Proficiency in cloud environments: AWS and/or Azure and/or Google Cloud Platform
- Strong knowledge of data platforms: Snowflake, Databricks, BigQuery
- Experience with Big Data technologies: Spark, PySpark, Kafka
- Proficiency in Python and SQL
- Knowledge of Java is a plus
- Familiarity with orchestration tools such as Airflow
- Experience with CI/CD environments, Git, and monitoring tools
- Experience in distributed architecture and managing large data volumes
- Analytical mindset and ability to solve complex problems
- Attention to detail
- Autonomy
- Responsiveness
- Critical thinking and ability to synthesize information
- Ability to work effectively in a team
- Strong communication skills with multidisciplinary stakeholders
- Adaptability and flexibility
- Sense of responsibility
- Passion for technology and continuous learning
Benefits
Comp & perks- Extensive training opportunities for employees
- Professional certifications
- Career development plans
- Training programs
- Friendly working environment
- Close-knit team
- Varied assignments for major clients
- Skills development policy