FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and enhancing cloud-based data pipelines and models on GCP, with a strong focus on data architecture, optimization, and security. Proficient in collaborating with cross-functional teams to advance data maturity and implement best practices in data management.
Highest-signal resume keywords
GCPDbtPySparkBigQueryDataflow
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data ModelingQuery OptimizationData ValidationShell ScriptingAdvanced SQL
Soft Skills
CollaborationCommunication
Tools & Technologies
TerraformDataprocCloud StorageGitJira
Industry Keywords
Data GovernanceIAM SecurityAgile MethodologiesData PipelinesCloud Security
Tech Stack
Tools & technologiesBigQueryCloudETLFirewallsGoogle Cloud PlatformHadoopPySparkPythonShell ScriptingSparkSQLTerraform
About the role
Key responsibilities & impact- Serve as a Senior Data Engineer on the collections squad of a large financial institution
- Build and enhance cloud-based data pipelines and models using dbt
- Participate in a data community of practice (chapter) and promote best practices
- Support business teams in advancing their data maturity
- Collaborate continuously with Data Science, BI, Data Engineering, and business teams
- Diagnose issues, propose standards, and document solutions
- Assess data warehouse architecture and requirements
- Map data, transformations, and processes across GCP services
- Define full-load, incremental, and CDC migration strategies
- Develop a data architecture plan on GCP
- Design BigQuery table schemas with performance, cost, and scalability in mind
- Define BigQuery partitioning and clustering strategies
- Model Bronze, Silver, and Gold zones in Cloud Storage
- Create transformations using Dataproc/Spark or Dataflow to load data into BigQuery
- Translate existing business logic and transformations in GCP
- Implement data validation and quality processes
- Use Terraform to provision and manage GCP resources
- Configure and optimize Dataproc clusters
- Manage networking, IAM security, and access controls in GCP
- Optimize BigQuery queries, Spark jobs, and GCP resource utilization
- Implement data security in transit and at rest
- Define and enforce IAM policies and ensure compliance with data governance requirements
- Troubleshoot performance and functional issues affecting pipelines and GCP resources
- Document architecture, pipelines, models, and operational procedures
- Communicate with team members, stakeholders, and other departments
- Ensure clear communication between architecture, software components, and ongoing development efforts
Requirements
What you’ll need- At least 3 years of proven experience with GCP
- At least 3 years of proven experience with dbt
- At least 3 years of proven experience with PySpark
- Proven knowledge of GitFlow
- In-depth knowledge of BigQuery, including data modeling, query optimization, partitioning, clustering, streaming and batch loads, security, and governance
- Experience with Cloud Storage, including buckets, storage classes, lifecycle policies, IAM, and data security
- Ability to provision, configure, and manage Spark/Hadoop clusters on Dataproc
- Knowledge of Dataflow, Composer, and dbt for ELT/ETL pipelines
- Experience implementing Cloud IAM policies and granular access controls
- Understanding of VPCs, networking, subnets, firewalls, and cloud security
- Python and PySpark
- Advanced SQL
- Shell scripting
- Git, GitHub, and Bitbucket
- Knowledge of Agile methodologies, ceremonies, and proficiency with Jira
Benefits
Comp & perks- Porto Seguro health insurance, with the option to add a spouse and children
- Porto Seguro dental insurance for employees and dependents
- Profit Sharing and Results (PLR)
- Childcare assistance
- Alelo meal and food vouchers
- Home office allowance
- Partnerships with educational institutions, offering discounts and incentives for courses and degree programs
- Certification incentives, including cloud certifications such as GCP, Azure, AWS, and others
- Livelo points
- TotalPass, offering discounted gym memberships for employees and family members
- Mindself, with incentives for meditation and mindfulness
- Ongoing training and professional development
