FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and implementing scalable data pipelines using Python, SQL, and AWS technologies, while ensuring adherence to best practices in software engineering and data governance. Proven ability to lead technical projects, mentor teams, and drive performance optimization in data engineering environments.
Highest-signal resume keywords
Data EngineeringPython (Fast API)SQLAWS Cloud InfrastructureData Warehousing (Snowflake)
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignETL/ELTData ModellingPerformance TuningClean Code PracticesArchitectural Design PatternsCI/CDMonitoringCost ManagementData Governance
Soft Skills
MentoringCollaborationOwnership MindsetPositive AttitudeProblem-Solving
Tools & Technologies
AirflowSparkKafkaSnowflakeGitAWS GlueGitHub ActionsTerraform
Industry Keywords
Big Data PlatformsContent Management SystemsSearchGraph DatabasesAnalytical Databases
Tech Stack
Tools & technologiesAirflowAWSCloudETLJavaKafkaPythonRDBMSSnowflakeSparkSpringSpring BootSpringBootSQLTerraform
About the role
Key responsibilities & impact- Lead the design, prototyping and build of robust and scalable data pipelines
- Set standards for clean code and best-practice software engineering across the team
- Work with Python (Fast API), Java (Spring Boot), Data Warehouse, Spark, Airflow, Snowflake, ETL/ELT, Iceberg, Kafka and RDBMS
- Own AWS cloud infrastructure to host, monitor and scale services
- Automate common tasks and drive cost and performance optimisation
- Partner with Product Managers, architects and engineering teams to translate requirements into scalable technical solutions, implementation plans and delivery roadmaps
- Mentor and coach engineers through design reviews, pair programming and code review
- Drive data quality, observability, governance and reliability practices, including SLAs, lineage and monitoring
- Contribute to architectural decisions for the wider Search and AI Platform
- Lead technical design and delivery of data pipelines and services for report generation across Libra services
Requirements
What you’ll need- 6+ years of professional experience in data engineering
- Strong skill set including SQL, Python, Airflow, Data Warehousing, Snowflake, AWS, Git, ETL/ELT and familiarity with AWS Glue
- Deep experience with SQL and data warehouses, preferably Snowflake, including data modelling, performance tuning and cost management at scale
- Best practices for rapid development of quality software, including clean code, architectural design patterns, testing strategy and CI/CD
- Ability to learn new technologies, languages and tools on the job
- Experience leading technical delivery of non-trivial projects end to end, from design through to production support
- Senior data engineering experience, including deputising for the technical lead, owning design and implementation of data systems and pipelines, and setting engineering standards
- Inclusive, positive, collaborative mindset and desire to deliver real business value
- Experience with large-scale content management systems and big data platforms (nice to have)
- Experience leading architectural decisions within a team or across teams (nice to have)
- Familiarity with CI/CD pipelines and infrastructure as code, including GitHub Actions and Terraform (nice to have)
- Exposure to search, graph, or large-scale analytical databases (nice to have)
- Strong ownership mindset and proven ability to drive outcomes in ambiguous problem spaces (nice to have)
Benefits
Comp & perks- Healthy work/life balance initiatives
- Wellbeing initiatives
- Family leave
- Tuition reimbursement
- Flexible working hours
- Group Health Insurance Policy (covering self and family)
- Group Life insurance/accident policy
- Generous long-service awards
- New Baby gift
- Subsidized food provided (applies to India- Chennai)
- Casual Leave
- Sick Leave
- Privilege Leave
- Compassionate Leave
- Special Sick Leave
- Gazetted Public Holiday
- Maternity/Paternity Leave
- Free Transport provided to and from the office (applies to India-Chennai)
