FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and maintaining end-to-end data pipelines using ELT/ETL methodologies, with a strong focus on data quality, security, and governance. Proficient in utilizing tools such as Snowflake, Airflow, and Python to optimize data processes and ensure efficient data integration and transformation.
Highest-signal resume keywords
SQL Query OptimizationSnowflake Data WarehousingAirflow Pipeline OrchestrationPython API DevelopmentData Security and Governance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
SQLSnowflakeDbtAirflowPythonFastAPIPostgresELT/ETLGitCI/CD
Tools & Technologies
AWS LambdaEKSPrometheusGrafanaCloudWatch
Industry Keywords
Data QualityData GovernanceMarket Data IntegrationData ContractsFinOps
Tech Stack
Tools & technologiesAirflowAWSETLGrafanaKafkaKubernetesPandasPostgresPrometheusPythonSQL
About the role
Key responsibilities & impact- Design, implement, and maintain end-to-end data pipelines (ELT/ETL), with a focus on reliability, reprocessing, and cost efficiency
- Orchestrate workloads and routines using Airflow (AWS) and AWS Lambda serverless functions; support deployments on EKS when necessary
- Model data in Snowflake across bronze, silver, and gold layers
- Develop transformations in dbt, including macros, tests, and documentation
- Build integrations and services in Python with FastAPI to expose and consume data and automate processes
- Consume, normalize, and version market data, with an emphasis on historical data and batch distribution
- Write high-performance SQL, including tuning and partitioning/clustering in Snowflake and Postgres
- Use Pandas for ad hoc processing, validation, and transformation prototyping
- Ensure data quality, observability, security, and documentation
- Collaborate with business, analytics, and product teams to define SLAs, data contracts, and governance standards
Requirements
What you’ll need- Solid experience with SQL (query optimization, relational and analytical modeling)
- Hands-on experience with Snowflake (warehousing, roles, tasks, performance, and costs) and dbt (models, tests, sources, and exposures)
- Experience building data pipelines in Airflow (DAGs, sensors, retries, and SLAs) and AWS Lambda
- Knowledge of Postgres (ingestion, basic replication/CDC or maintenance, and routines)
- Experience using Python for data (Pandas) and developing APIs with FastAPI
- Practical experience with batch-oriented ELT/ETL, Git version control, and CI/CD
- Understanding of data security and governance (access control, lineage, documentation, and sensitive data)
- Technical English for reading documentation
- Experience with EKS/Kubernetes for data workloads is a plus
- Experience integrating market data sources is a plus
- Monitoring/observability with Prometheus, Grafana, or CloudWatch is a plus
- Data quality experience with Great Expectations or Soda is a plus
- Experience with data contract standards using Pydantic/JSON Schema is a plus
- Snowflake performance optimization experience is a plus
- Experience with data costs and FinOps in AWS/Snowflake is a plus
- Experience with CDC (Debezium, DMS) and messaging (SQS, SNS; Kafka only when necessary) is a plus
Benefits
Comp & perks- Health and dental insurance
- Food and meal allowance
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
- Profit-Sharing and Results Program (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to promoting physical and mental health and well-being
- Pregnancy and responsible parenting course
- Partnerships with online course platforms
- Language learning platform
- Support and accommodations for people with disabilities throughout the recruitment process
- Dedicated Health and Well-being team
- Inclusion specialists and employee affinity groups
