FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and maintaining scalable data pipelines, data modeling, and implementing data validation processes. Proficient in SQL and programming languages like Python, with experience in cloud platforms and data warehousing.
Highest-signal resume keywords
Data Pipeline DevelopmentAdvanced SQL KnowledgeData Warehousing ExperienceCloud Platform FamiliarityData Modeling Proficiency
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline DesignSQLPythonData WarehousingData ModelingData ValidationSchema DesignData ProcessingData TransformationQuery Optimization
Soft Skills
Problem-SolvingAttention to DetailSelf-DrivenMotivatedFast Learner
Tools & Technologies
AWSAzureGoogle Cloud PlatformKafkaFlinkSpark Streaming
Industry Keywords
Data EngineeringData StorageData Processing SystemsData IntegrityData Access
Tech Stack
Tools & technologiesAWSAzureCloudGoogle Cloud PlatformKafkaPythonSparkSQL
About the role
Key responsibilities & impact- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design appropriate solutions
- Work closely with IT and infrastructure teams to deploy and maintain data storage and processing systems, including databases, data warehouses, and cloud infrastructure
- Design, build, and maintain robust, scalable data pipelines to ingest, process, and transform data from internal databases and external APIs
- Optimize data pipelines for performance, scalability, and reliability, ensuring timely and accurate delivery of data
- Implement data validation and quality checks to identify and rectify issues in data pipelines, ensuring data integrity
- Explore and evaluate new technologies, tools, and frameworks to improve data engineering processes and capabilities
- Perform data modeling and schema design to support analytical and reporting requirements
- Design and build data marts and business layers to facilitate efficient data access and analysis
Requirements
What you’ll need- Bachelor’s degree in Computer Science, Information Systems, or other related technical field or equivalent work
- Proven experience as a Data engineer or similar role, with at least 4 years of experience
- Advanced SQL knowledge/experience - complex queries and query optimization
- Proficiency in programming languages such as Python
- Experienced in the development of data warehouses and proficient in data modeling
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform
- Experience in building data streams using technologies such as Kafka, Flink, or Spark Streaming is considered a plus
- Strong problem-solving skills and attention to detail
- Ability and willingness to learn new technologies on the job
- Self driven, highly motivated, fast learner, ambitious and creative