FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and optimizing data pipelines, with a strong command of the GCP Cloud ecosystem and proficiency in Python. Capable of implementing data governance and security measures while contributing to data platform modernization and automation efforts.
Highest-signal resume keywords
Data Pipeline DesignGCP Cloud EcosystemPython ProficiencyData Governance ImplementationOrchestration Tools Experience
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonSQLGCPApache SparkData ModelingData GovernanceInfrastructure as CodeCI/CDOrchestration ToolsData Warehousing
Soft Skills
Knowledge SharingCollaboration
Tools & Technologies
DatabricksSnowflakeApache AirflowTerraformGitGitLab CIGitHub ActionsConfluentApache KafkaDbt
Industry Keywords
Data EngineeringData GovernancePII Privacy ManagementSecNumCloudEU AI ActNIS2DORAEco-Friendly PipelinesData Carbon FootprintMedallion Architecture
Tech Stack
Tools & technologiesAirflowApacheCloudGoogle Cloud PlatformJavaKafkaPySparkPythonScalaSparkSQLTerraformTypeScriptGo
About the role
Key responsibilities & impact- Design, develop, and optimize batch and streaming data pipelines
- Ingest, collect, and store raw data in a distributed manner within data warehouses or Lakehouse and medallion architectures (Bronze, Silver, Gold)
- Automate infrastructure deployments using Infrastructure as Code and CI/CD
- Secure data and implement data governance, including PII privacy management, RLS/CLS access controls, and traceability
- Continuously optimize the performance and scalability of data processing workloads
- Model data to optimize pipeline performance and data consumption
- Contribute to data platform modernization and migration projects involving GCP/S3NS, Databricks, or Snowflake
- Integrate AI into the software and data lifecycle and automate code and pipeline quality assurance
- Design audit and trust architectures compliant with SecNumCloud 3.2, the EU AI Act, or NIS2/DORA
- Design eco-friendly pipelines, measure the data carbon footprint, and optimize computing and Cloud resources
- Work within integrated teams and contribute to guilds, pair programming, and peer-to-peer knowledge sharing
- Participate in a recruitment process including an introductory discussion, a technical interview, and a consulting/culture discussion
Requirements
What you’ll need- At least 4 years of experience in a Data Engineer role
- Proficiency in Python
- Essential: strong command of the GCP Cloud ecosystem
- Solid experience with orchestration tools such as Airflow, Kestra, or Dagster
- Strong focus on code quality and Software Craftsmanship
- Java or Scala experience is a plus
- Experience with Spark is a plus
- Knowledge of Python, SQL, Java, Scala, and Apache Spark (PySpark)
- Knowledge of dbt and Dataform
- Knowledge of Confluent and Apache Kafka
- Knowledge of Google Cloud / S3NS, Databricks, and Snowflake
- Knowledge of Apache Airflow, Terraform, Git, GitLab CI, or GitHub Actions
- A passion for knowledge sharing
- Experience across multiple technical and functional ecosystems
Benefits
Comp & perks- Minimum of 2 certifications per year (Google Cloud, Databricks, dbt, Confluent, Snowflake, Airflow, Terraform)
- Career development opportunities toward roles such as Technical Lead, Data Architect, Partner Subject-Matter Expert, Manager, or Trainer
- Internal guilds, pair programming, and peer-to-peer knowledge sharing
- Talks, training, and open-source projects
- Flexible remote work
- Respect for personal time
- Transparent compensation
- Responsible business model focused on inclusion, workplace equality, and digital sustainability
- Work environment built on active listening and fairness
- Recruitment process adapted to individual needs
- Onboarding adapted to individual needs
