FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and maintaining data ingestion pipelines using Google Cloud technologies, particularly BigQuery and Cloud Storage, while orchestrating workflows with Apache Airflow. Proficient in SQL and Python for data modeling and pipeline development, with a strong focus on data quality and integration from various sources.
Highest-signal resume keywords
Google Cloud ExperienceApache Airflow OrchestrationSQL Data ModelingPython Data Pipeline DevelopmentMedallion Architecture Knowledge
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Ingestion PipelinesSQLPythonData ModelingApache AirflowBigQueryCloud StorageData Quality AssuranceVersion ControlMachine Learning Data Preparation
Soft Skills
Analytical ThinkingCollaborationDocumentationTraining SupportProblem Solving
Tools & Technologies
Google CloudApache AirflowBigQueryCloud StorageERP Systems
Certifications & Qualifications
Google Cloud Certifications
Industry Keywords
Data EngineeringMedallion ArchitectureData IntegrationEnterprise DataConsulting Projects
Tech Stack
Tools & technologiesAirflowApacheBigQueryCloudPythonSQL
About the role
Key responsibilities & impact- Build and maintain data ingestion pipelines from ERP systems, quality and production systems, portals, spreadsheets, and external sources
- Orchestrate pipeline extraction, scheduling, and failure handling with Apache Airflow
- Implement the Medallion Architecture (Bronze, Silver, and Gold), with raw data in Cloud Storage and data modeling in BigQuery
- Model business entities and shared master data, such as customers, products, and third parties
- Support the semantic layer that powers dashboards
- Reconcile hub data with source systems, ensuring data quality and consistency
- Prepare and make Gold entities available for AI and machine learning models
- Version code and manage deployments across development, staging, and production environments
- Monitor pipeline execution and resolve failures, striving for operation without manual intervention
- Document pipelines, data models, and technical decisions
- Support client team training during the final delivery
- Participate in weekly reviews and validate deliverables with business teams
- Work in a multidisciplinary squad alongside architecture and data science teams to build a centralized data hub on Google Cloud for a major building materials company
Requirements
What you’ll need- 5+ years of experience as a data engineer working on cloud data projects
- 3+ years of experience with Google Cloud, especially BigQuery and Cloud Storage
- 3+ years of experience orchestrating pipelines with Apache Airflow
- Strong SQL and analytical data modeling skills, with 5+ years of experience
- 4+ years of experience using Python to build data pipelines
- Knowledge of the Medallion Architecture (Bronze, Silver, and Gold)
- Experience integrating data from multiple sources, such as ERPs, APIs, files, and spreadsheets
- Experience with code version control and deployments across environments
- Google Cloud certifications are a plus
- Experience extracting data from enterprise ERP systems is a plus
- Knowledge of tax, financial, or industrial data is a plus
- Experience preparing data for machine learning models is a plus
- Consulting project experience is a plus
- Hands-on experience with Google Cloud (BigQuery and Cloud Storage), Apache Airflow, SQL, and Python is essential
Benefits
Comp & perks- Ongoing professional development
- Remote work
- Commitment to the inclusion of people with disabilities (this position is also open to candidates with disabilities)